-- Logs begin at Mon 2022-10-10 11:12:54 UTC, end at Mon 2022-10-10 12:33:02 UTC. -- Oct 10 11:45:48.325905 dv-cinder-860209-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 10 11:45:48.339207 dv-cinder-860209-4-smb devstack@keystone.service[81585]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 10 11:45:48.346753 dv-cinder-860209-4-smb devstack@keystone.service[81585]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 11:45:48 2022] *** Oct 10 11:45:48.347132 dv-cinder-860209-4-smb devstack@keystone.service[81585]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: nodename: dv-cinder-860209-4-smb Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: machine: x86_64 Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: clock source: unix Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: pcre jit disabled Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: detected number of CPU cores: 4 Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: current working directory: / Oct 10 11:45:48.347379 dv-cinder-860209-4-smb devstack@keystone.service[81585]: detected binary path: /usr/bin/uwsgi-core Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: your processes number limit is 47680 Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: your memory page size is 4096 bytes Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: detected max file descriptor number: 2048 Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: lock engine: pthread robust mutexes Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: thunder lock: enabled Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 10 11:45:48.348214 dv-cinder-860209-4-smb devstack@keystone.service[81585]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 11:45:48.389952 dv-cinder-860209-4-smb devstack@keystone.service[81585]: Python main interpreter initialized at 0x561b77f929c0 Oct 10 11:45:48.389952 dv-cinder-860209-4-smb devstack@keystone.service[81585]: python threads support enabled Oct 10 11:45:48.389952 dv-cinder-860209-4-smb devstack@keystone.service[81585]: your server socket listen backlog is limited to 100 connections Oct 10 11:45:48.389952 dv-cinder-860209-4-smb devstack@keystone.service[81585]: your mercy for graceful operations on workers is 90 seconds Oct 10 11:45:48.390686 dv-cinder-860209-4-smb devstack@keystone.service[81585]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 11:45:48.390686 dv-cinder-860209-4-smb devstack@keystone.service[81585]: *** Operational MODE: preforking *** Oct 10 11:45:48.390686 dv-cinder-860209-4-smb devstack@keystone.service[81585]: *** uWSGI is running in multiple interpreter mode *** Oct 10 11:45:48.390686 dv-cinder-860209-4-smb devstack@keystone.service[81585]: spawned uWSGI master process (pid: 81585) Oct 10 11:45:48.390931 dv-cinder-860209-4-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 10 11:45:48.393984 dv-cinder-860209-4-smb devstack@keystone.service[81585]: spawned uWSGI worker 1 (pid: 81597, cores: 1) Oct 10 11:45:48.393984 dv-cinder-860209-4-smb devstack@keystone.service[81585]: spawned uWSGI worker 2 (pid: 81598, cores: 1) Oct 10 11:45:48.393984 dv-cinder-860209-4-smb devstack@keystone.service[81585]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 11:45:52.895001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:52.895001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: from cryptography.utils import int_from_bytes Oct 10 11:45:52.896058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:52.896058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: from cryptography.utils import int_from_bytes Oct 10 11:45:52.896790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:52.896790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: from cryptography.utils import int_from_bytes Oct 10 11:45:52.897007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:52.897007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: from cryptography.utils import int_from_bytes Oct 10 11:45:52.947585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:45:52.947778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:45:52.947874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:45:52.947962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:45:52.948030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] command line args: [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:45:52.948094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] command line args: [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:45:52.948211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:45:52.948346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:45:52.948443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ================================================================================ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:45:52.948527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ================================================================================ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:45:52.948607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] admin_token = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.948715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] admin_token = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.948857 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_dir = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.948966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config_dir = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_source = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] config_source = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] debug = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] debug = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.949947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.950982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_config_append = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_config_append = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_dir = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_dir = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.951957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.952926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.953908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.954904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.955948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] publish_errors = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] publish_errors = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.956983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] standard_threads = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] standard_threads = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.957892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_journal = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_journal = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_json = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_json = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_stderr = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_stderr = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.958992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_syslog = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.959111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] use_syslog = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.959222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.959356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:52.959468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.959580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.959689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.959800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.959919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.960970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.961808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.963869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.964989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.965953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.966934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.967946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.968913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.969916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.970910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.971375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.971511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.971649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.971793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.971943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.972939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.973879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.974072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.974243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.974413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.974597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.974801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.974939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.975148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.975289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.975426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.975556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.975701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.975833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.976873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.977996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.978674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.978806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.978806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.979949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.980876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.981984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.982242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.982376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.982518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.982652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.982787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.982987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.983954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.984834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.985086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.985279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.985414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.985547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.985693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.985824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.986811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.987935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.988988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.989123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.989258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.989393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.989524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.989671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.989802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.external = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.990944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.external = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.991913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.password = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] auth.token = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.password = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.token = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.992919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.993038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.993184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.993327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.993469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.993600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.994357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.994524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.994655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.994788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.994926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.995884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.996028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.996172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.996306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.996499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.996634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.996858 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.997041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.997195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.997331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.997568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.997702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.997835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.998859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:52.999938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.000925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.001953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.002865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.003998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.004993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.005143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.005277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.005413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.005533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.005655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.006967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.007920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.008976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.009182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.009182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.009307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.009886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.009952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.009952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010858 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.010995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.011986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.012987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.013957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.014995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.015948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.016963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.017989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.018932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.019910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.020906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.021991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.022881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.023892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.024802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.025544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.025746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.025983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.026995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.027974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.028995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.029802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.030973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.031902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.032966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.033111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.033241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.033373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.033509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.033696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.033837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.034919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.035886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.036956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.037091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.037224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.037373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.037511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.037647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.037783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.038960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.039243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.039400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.039537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.039537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.039807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.039946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.040892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.041885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.042904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.043948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.044892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.045021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.045021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:45:53.045277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:53.045277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:45:53.067041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.067247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.067320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.067423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.067503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.067575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.076615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.076805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.106389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.106624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.106624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.106762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.162379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.162562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.213542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.213752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.214100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.214339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.373475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.373702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.373937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.374867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.375084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.375299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.398663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.398896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.398991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.399798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.400410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.400543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.400652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.400743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.412146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.412363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.425960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.426904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.427027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.427163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.427248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.427423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.427548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:53.444107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.444370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:53.444588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.444724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.444854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:53.444982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:53.445108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.445243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.445374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:53.445513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.445640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.445765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.445912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.446048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.446177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.446345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.455587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.455893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.456044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.456159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.456333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.456456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.456612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.456903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.464090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.464529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.467039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.467331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.467622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.467764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.467914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.467998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.468208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.468313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.468477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.468568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.468757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.468848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.469908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.470005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.470199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.470475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.493519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.494303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.495101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.495390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.495804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.496092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.500135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.500423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.500716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.500928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.501219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.501506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.507389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.507686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.508238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.508536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.513736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.513736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.514377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.514545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.514688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.514920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.515098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.515180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.515243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.515443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.516449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.516449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.516688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.516688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.516688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.516688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.531871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.532160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.532639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.532923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.536050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.536815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.539359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.539661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.540104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.540409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.544652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.545640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.548115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.549071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.551689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.552012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.552304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.552518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.552614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.552844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.552935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.553136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.553277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.553422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.553704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.554019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.569523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.569836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.570137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.570415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.570733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.571053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.571330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.571598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.577664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.578761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.579311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.580388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.580882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.581173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.582054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.582342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.584024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.584321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.584611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.584901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.585091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.585316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.585473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.585653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.585969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.586392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.597358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.597674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.597963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.598255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.598400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.598617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.598855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.599009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.599154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.599296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.599436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.599590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.599853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.600139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.615758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.616473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.618935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.619592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.622015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.622616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.623591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.624202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.625114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.625405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.625710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.625928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.626070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.626453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.632704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.633490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.634824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.635645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.637887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.638329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.638626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.638711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.638912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.639103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.639402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.639687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.647058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.647369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.647663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.647812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.648075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.648364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.655386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.655687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.655976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.656061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:53.656261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.656353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.656542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.656642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.656825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.656966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.657956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.658939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.659052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.659184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.659339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.659610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:53.700256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b77f929c0 pid: 81598 (default app) Oct 10 11:45:53.700506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b77f929c0 pid: 81597 (default app) Oct 10 11:45:53.700649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e956-839b-4352-8bd0-67a51baa654e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.700649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e956-839b-4352-8bd0-67a51baa654e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.700649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e956-839b-4352-8bd0-67a51baa654e None None] PATH_INFO: `/v3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.703810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:01.837443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.838081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.838081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.842481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:01.848813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.849409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.849409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.988033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: INFO dbcounter [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] Registered counter for database keystone Oct 10 11:46:02.022256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG oslo_db.sqlalchemy.engines [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:46:02.029608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writer thread running {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:46:02.223310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG passlib.handlers.bcrypt [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81598) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 10 11:46:02.223762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG passlib.handlers.bcrypt [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81598) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 10 11:46:02.285214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:02.287115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:02.426974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 579 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 11:46:02.783218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.856575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: INFO dbcounter [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] Registered counter for database keystone Oct 10 11:46:02.881181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG oslo_db.sqlalchemy.engines [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:46:02.889138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writer thread running {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:46:03.016301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2ecbc-c879-4358-a04d-219bf9febc44 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.020851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.021552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.021916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.022239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.032178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.086036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING keystone.common.rbac_enforcer.enforcer [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 10 11:46:03.086338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e803-b4ef-412d-96fe-20e9fd87198a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.096909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 11:46:03.103192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.121295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee165-5597-41ff-be21-fa2fae67d7da None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.125828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.126985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.127274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.127551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] PATH_INFO: `/v3/projects/8cf9335e1dea43c7bd781d2850348eb6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.129228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] RBAC: Authorizing `identity:get_project(project_id=8cf9335e1dea43c7bd781d2850348eb6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.183209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 10 11:46:03.183567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7814a6-1338-42b2-b99c-3ecd023a6985 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.188267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/projects/8cf9335e1dea43c7bd781d2850348eb6 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:05.399268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ec81-0c36-438e-9d76-ce2016e37d35 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.400317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ec81-0c36-438e-9d76-ce2016e37d35 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.400499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ec81-0c36-438e-9d76-ce2016e37d35 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.404879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:05.411212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.411809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.411809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.433123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:05.434763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:05.442933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 11:46:05.710651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ec81-0c36-438e-9d76-ce2016e37d35 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:05.723506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ec81-0c36-438e-9d76-ce2016e37d35 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:05.727923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ad01b-4eb3-4a56-b3cb-40375253ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:05.728530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad01b-4eb3-4a56-b3cb-40375253ad07 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.728813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad01b-4eb3-4a56-b3cb-40375253ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.729082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ad01b-4eb3-4a56-b3cb-40375253ad07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.737445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad01b-4eb3-4a56-b3cb-40375253ad07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:05.739272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ad01b-4eb3-4a56-b3cb-40375253ad07 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:05.748874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Oct 10 11:46:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 11:46:05.755093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:05.766288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf461c8-bf06-4fcc-9f47-fab5f20ebeb7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:05.771285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242ca1-f961-4594-953d-27ee41cc05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:05.771955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242ca1-f961-4594-953d-27ee41cc05c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.772241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242ca1-f961-4594-953d-27ee41cc05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.772521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242ca1-f961-4594-953d-27ee41cc05c0 admin admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.774084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242ca1-f961-4594-953d-27ee41cc05c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:05.776588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242ca1-f961-4594-953d-27ee41cc05c0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:05.778401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Mon Oct 10 11:46:05 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:08.182071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56eb4-5874-4ee7-91db-fb28ce443917 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.182715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56eb4-5874-4ee7-91db-fb28ce443917 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.182715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56eb4-5874-4ee7-91db-fb28ce443917 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.184592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:08.190477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.191198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.191198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.210642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:08.212530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:08.242486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1e97-9af7-4680-b33f-4dcbfdebd9b5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.242994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1e97-9af7-4680-b33f-4dcbfdebd9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.244032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c1e97-9af7-4680-b33f-4dcbfdebd9b5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.246542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:08.253531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.254174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.254679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.304934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:08.333784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG passlib.handlers.bcrypt [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81597) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 10 11:46:08.334578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG passlib.handlers.bcrypt [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81597) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 10 11:46:08.389727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:08.392567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:08.574309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:08.582529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:08.599540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:08.708130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537960-3db5-4614-b2da-8c9690d6f65d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.767198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.768213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.768709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.769188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.867767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:08.891042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.893598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.922318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.004025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b797b1-abc7-424f-9611-385e2889c342 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.006791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.045370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:09.045653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.046819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.047431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.047798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.051243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.064048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:09.073826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:09.075928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:09.077984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:09.081645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.174863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160ac5-7663-4b01-baf1-24281e33f217 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.200238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b5d47-b3ca-48b1-b64f-1de7b238861f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.201078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.214290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.214290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.214290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.222401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.228189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.230092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.244353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.245301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.245755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.246244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.247357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:09.248025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.250568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:09.258690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:09.260411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:09.261945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:09.261945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:09.261945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:09.261945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 8/16] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:09.267556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.278033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:09.279440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.317644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.390759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1dbba-ca40-4c5e-a333-52fb8642da2f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.425767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d1715-16c1-4833-b168-f21c80a7e378 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.428519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.429127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.429416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.429704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.430390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:09.431227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.432737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.451851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:09.485551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.486257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.486535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.486806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.488508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.490064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.491922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:09.498427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.542574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.625341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8080c-410a-4d94-b04d-4fa84a0bfe79 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.665763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff087d6-57bc-4d78-a659-106973d0fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.669304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff087d6-57bc-4d78-a659-106973d0fb89 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.669304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff087d6-57bc-4d78-a659-106973d0fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.669304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff087d6-57bc-4d78-a659-106973d0fb89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.669304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff087d6-57bc-4d78-a659-106973d0fb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.670192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff087d6-57bc-4d78-a659-106973d0fb89 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.671794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:09.678254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.824886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.836211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa704-bbb9-4981-ac67-9e2f16fe85e5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.890561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.891396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.891806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.892204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.893257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.domain.id=default, user.id=8fe6fac414db46e48e059a12469c4bfd) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:09.893771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.895885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0ca9-3725-4d40-9328-dbb83f42bc5b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.908381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/role_assignments?user.id=8fe6fac414db46e48e059a12469c4bfd&scope.domain.id=default&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 233 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:12.728527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0455d-b393-43dd-ac9a-2a983af1cbb4 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.728527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0455d-b393-43dd-ac9a-2a983af1cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.728527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0455d-b393-43dd-ac9a-2a983af1cbb4 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.729638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:12.740813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698f91-5a0a-4933-8889-8ac585a12774 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.742251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698f91-5a0a-4933-8889-8ac585a12774 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.743066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698f91-5a0a-4933-8889-8ac585a12774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.786261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-83698f91-5a0a-4933-8889-8ac585a12774 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:12.788575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-83698f91-5a0a-4933-8889-8ac585a12774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:12.937790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:13.043457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7a39-a79f-4d8c-a69b-a806f205699f None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.044221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7a39-a79f-4d8c-a69b-a806f205699f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.044839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a7a39-a79f-4d8c-a69b-a806f205699f None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.047383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:13.054383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d35d-db6a-48b7-8452-468c75ac12fe None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.055202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d35d-db6a-48b7-8452-468c75ac12fe None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.055728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d35d-db6a-48b7-8452-468c75ac12fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.095005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6505d35d-db6a-48b7-8452-468c75ac12fe None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:13.097427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6505d35d-db6a-48b7-8452-468c75ac12fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:13.258532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:13.434778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a7a39-a79f-4d8c-a69b-a806f205699f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:13.474928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c507113-a6ed-4e1d-8761-051120af8e02 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.475950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c507113-a6ed-4e1d-8761-051120af8e02 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.476728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c507113-a6ed-4e1d-8761-051120af8e02 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.480003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 14/26] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:13.489670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.490823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.491605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.539005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:13.540270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:13.570565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.647288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a7a39-a79f-4d8c-a69b-a806f205699f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:13.649331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.692140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:13.736511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:13.737226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.737440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.737718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.757842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.760059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-3d6314f2-35ee-4f20-85f1-07b4a7e29774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:13.787147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:13.788129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:13.789748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:13.789748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:13.789748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:13.789748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 13/28] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:13.794328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:13.881043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bff2a-54d8-4978-bc03-a397c037a171 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.881374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bff2a-54d8-4978-bc03-a397c037a171 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.881611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bff2a-54d8-4978-bc03-a397c037a171 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.883010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 14/29] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:13.888666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.889033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.889377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.909096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:13.910579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:13.958565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3426a-832c-4362-bf35-0e10c5f7abf9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.032888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 15/30] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:14.033783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.050160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.050790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.058078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.058444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.059236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:14.059552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.060990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.108666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 16/31] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:14.109550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.144623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.177808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79f0e-6cf3-48c7-a8e2-00e30c2e76df None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.182395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.220605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.221571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.222038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.222802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.237789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:14.245158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:14.246268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:14.247182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:14.249253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 16/32] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:14.250531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.344792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1be17-7a69-4807-b891-5464ac589eac None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.376137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d93697-fcfc-469b-b3c9-788b5ef2b54d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.396841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.397470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.397754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.398064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.398766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.400757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.427429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f5ce7-27e9-437a-890c-95d393b887fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.434067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f5ce7-27e9-437a-890c-95d393b887fa None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.434067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f5ce7-27e9-437a-890c-95d393b887fa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.434067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f5ce7-27e9-437a-890c-95d393b887fa None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.434067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f5ce7-27e9-437a-890c-95d393b887fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.434067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f5ce7-27e9-437a-890c-95d393b887fa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.454917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.626271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 17/33] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/roles => generated 219 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:14.627687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.674179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 17/34] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/projects => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:14.675974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744d4d-2b41-47f4-834e-c1e121dfa776 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.676456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744d4d-2b41-47f4-834e-c1e121dfa776 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.677303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744d4d-2b41-47f4-834e-c1e121dfa776 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.679456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 18/35] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:14.686462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744d4d-2b41-47f4-834e-c1e121dfa776 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.726734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.773172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a007-7e68-45e2-a2fe-2ccad109308f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.835013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.836577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.837153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.837632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.838957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:14.839879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.844062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb688bd-aa7c-45a5-8f68-d07dd5b32ee0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.866746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 18/36] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:14.870724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e123d-6f21-4f3a-b146-c9850c71e750 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.871165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e123d-6f21-4f3a-b146-c9850c71e750 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.871633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e123d-6f21-4f3a-b146-c9850c71e750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.902113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744d4d-2b41-47f4-834e-c1e121dfa776 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.916505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6d1e123d-6f21-4f3a-b146-c9850c71e750 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:14.920882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d1e123d-6f21-4f3a-b146-c9850c71e750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:14.952074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56486138-b673-4deb-b467-805e86b7a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.956920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56486138-b673-4deb-b467-805e86b7a0be None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.957235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56486138-b673-4deb-b467-805e86b7a0be None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.957494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56486138-b673-4deb-b467-805e86b7a0be None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.958945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56486138-b673-4deb-b467-805e86b7a0be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.960921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56486138-b673-4deb-b467-805e86b7a0be None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.035272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 19/37] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:15.036639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d35f-ed37-4603-9a05-4e66c03aeff6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.036933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d35f-ed37-4603-9a05-4e66c03aeff6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.037212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d35f-ed37-4603-9a05-4e66c03aeff6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.038683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 20/38] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:15.039511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873d35f-ed37-4603-9a05-4e66c03aeff6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.059082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/roles => generated 225 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:15.063073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.064534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.065351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.109287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:15.113766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:15.128168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.188399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873d35f-ed37-4603-9a05-4e66c03aeff6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.237976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.238646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.238919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.239256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.240692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.242329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.244240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 21/40] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.250339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.257462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.302408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 20/41] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:15.401322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f09f2-b1fb-4112-af04-658776d2260a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.433115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.456767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.458028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.459123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.459123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.460954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.466147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.467948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 22/42] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:15.477369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.522777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.627272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e7ee-e4b8-4604-a072-cdeae4a7ec12 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.679490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.680208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.680466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.680756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] PATH_INFO: `/v3/domains/default/users/8fe6fac414db46e48e059a12469c4bfd/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.683403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8fe6fac414db46e48e059a12469c4bfd, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.684865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.699652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1002ac6-d871-49cd-a486-83027c5e6534 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.739200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.739775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.740102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.740424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.741195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.743200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.785400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 21/43] 10.222.0.47 () {58 vars in 1361 bytes} [Mon Oct 10 11:46:15 2022] PUT /identity/v3/domains/default/users/8fe6fac414db46e48e059a12469c4bfd/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:15.786629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.848091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.873917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Oct 10 11:46:15 2022] POST /identity/v3/roles => generated 223 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:46:15.928826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be9cc-5a60-4be6-9370-8f2d394a5314 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.975100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c4aa0-5bf5-460c-a935-c5ab403acd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.978115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c4aa0-5bf5-460c-a935-c5ab403acd23 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.978486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c4aa0-5bf5-460c-a935-c5ab403acd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.978721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c4aa0-5bf5-460c-a935-c5ab403acd23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.980118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c4aa0-5bf5-460c-a935-c5ab403acd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.981675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c4aa0-5bf5-460c-a935-c5ab403acd23 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.983842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 22/45] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.989827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:16.071665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:16.159379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a448cc3-4e01-477c-b093-04b28edb2e6e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:16.219075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f4a9b-76f7-46ac-9b01-64871458cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:16.219710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f4a9b-76f7-46ac-9b01-64871458cbf1 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:16.219997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f4a9b-76f7-46ac-9b01-64871458cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:16.220274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f4a9b-76f7-46ac-9b01-64871458cbf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:16.220948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f4a9b-76f7-46ac-9b01-64871458cbf1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:16.222495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f4a9b-76f7-46ac-9b01-64871458cbf1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:16.330258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:46:15 2022] POST /identity/v3/projects => generated 312 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:46:18.156913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4b33d-e517-440f-b8ad-e41f9848d2b9 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.157532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4b33d-e517-440f-b8ad-e41f9848d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.157532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4b33d-e517-440f-b8ad-e41f9848d2b9 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.158890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 23/47] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:18.164796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62190205-a3dc-4157-9741-43c6d97920ed None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.165287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62190205-a3dc-4157-9741-43c6d97920ed None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.165466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62190205-a3dc-4157-9741-43c6d97920ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.186378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-62190205-a3dc-4157-9741-43c6d97920ed None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:18.187618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-62190205-a3dc-4157-9741-43c6d97920ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:18.263686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:18.537317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4b33d-e517-440f-b8ad-e41f9848d2b9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.779284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4b33d-e517-440f-b8ad-e41f9848d2b9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.797798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8207c-b452-40fd-8703-9ec1b4e01793 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.798353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8207c-b452-40fd-8703-9ec1b4e01793 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.798767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8207c-b452-40fd-8703-9ec1b4e01793 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.800410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 26/49] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:18.806830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.807877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.808338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.808677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.833066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:18.834595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:18.836231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.836945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.837389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.837749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.852890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:18.859144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:18.861005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:18.862544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 24/50] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:18.868920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.875721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.938136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 27/51] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:19.009176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcb81-efac-484c-853d-8294f106d14f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.051375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.052140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.052541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.052950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.053764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:19.054226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.056311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.070619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 25/52] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:19.077828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.218847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.240245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b19b90-fb44-4bdf-a48d-cc8ebfe255b8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.282477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.373635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198056-d52a-47d3-920a-4ab0554afa34 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.388122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.388773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.389059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.389336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.390577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.392096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.393843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 28/53] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:19.399594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.419674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.420572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.421026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.421404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.422956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.424699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.427134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 26/54] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:19.436057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.443013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.527259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f64a3-065e-4048-9983-78d8d035d14a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.572171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.572976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.573324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.573662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.575088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.576870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.578798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 29/55] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:19.584813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.586131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256df3f-6954-4d06-bcc6-fbc846db6f1e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.590185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.626546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa078f-9349-463d-987a-f2b0a3adcc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.627058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa078f-9349-463d-987a-f2b0a3adcc89 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.627344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa078f-9349-463d-987a-f2b0a3adcc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.627623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa078f-9349-463d-987a-f2b0a3adcc89 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.628305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa078f-9349-463d-987a-f2b0a3adcc89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.629817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa078f-9349-463d-987a-f2b0a3adcc89 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.710340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed97a5-318e-4364-a511-9dfda640075f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.715387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.724031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 27/56] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Oct 10 11:46:19 2022] POST /identity/v3/projects => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:46:19.764652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.765398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.765801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.766452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.767394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.domain.id=default, user.id=8fe6fac414db46e48e059a12469c4bfd) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:19.767823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.770175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286de4d-6a56-4f62-a81f-5e80e9eccf88 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.778822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 30/57] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/role_assignments?user.id=8fe6fac414db46e48e059a12469c4bfd&scope.domain.id=default&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 530 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:21.992994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be19af-cf63-4583-bdbc-fba31e008dda None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.993795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be19af-cf63-4583-bdbc-fba31e008dda None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.993968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be19af-cf63-4583-bdbc-fba31e008dda None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.995399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 28/58] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:22.001443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.001977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.002082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.021218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:22.022507 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:22.099404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:22.373755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be19af-cf63-4583-bdbc-fba31e008dda None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:22.487901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be19af-cf63-4583-bdbc-fba31e008dda None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.525595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ff893-c7ea-4f91-b321-a7cb5333400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.526330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff893-c7ea-4f91-b321-a7cb5333400c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.526659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff893-c7ea-4f91-b321-a7cb5333400c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.526994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ff893-c7ea-4f91-b321-a7cb5333400c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.528292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ff893-c7ea-4f91-b321-a7cb5333400c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:22.529902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ff893-c7ea-4f91-b321-a7cb5333400c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:22.531695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 29/60] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:22.538023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:22.704164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:22.711222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa202-858e-4f60-9c60-171bb666df79 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.776357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e22652-cb97-4988-a887-e6628c8735b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.777391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22652-cb97-4988-a887-e6628c8735b7 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.777936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22652-cb97-4988-a887-e6628c8735b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.778435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22652-cb97-4988-a887-e6628c8735b7 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.779643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e22652-cb97-4988-a887-e6628c8735b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:22.782460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e22652-cb97-4988-a887-e6628c8735b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:22.905881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:22 2022] POST /identity/v3/users => generated 275 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:26.826148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ca6c-e8ec-427c-bb98-2268ee7b5e8e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.826876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ca6c-e8ec-427c-bb98-2268ee7b5e8e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.826876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ca6c-e8ec-427c-bb98-2268ee7b5e8e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.828405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 30/62] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:26.847830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19116-60c0-42ea-9b30-9bda3ad68372 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.848563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19116-60c0-42ea-9b30-9bda3ad68372 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.848563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf19116-60c0-42ea-9b30-9bda3ad68372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.872899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1bf19116-60c0-42ea-9b30-9bda3ad68372 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:26.874151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1bf19116-60c0-42ea-9b30-9bda3ad68372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:26.943455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09affc-14b5-4eb8-bdef-fd4a46278768 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.943869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09affc-14b5-4eb8-bdef-fd4a46278768 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.944042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09affc-14b5-4eb8-bdef-fd4a46278768 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.946199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:26.958163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81e2e-a2e2-46a9-b142-550ab6e21454 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.958530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81e2e-a2e2-46a9-b142-550ab6e21454 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.958768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc81e2e-a2e2-46a9-b142-550ab6e21454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.985135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ebc81e2e-a2e2-46a9-b142-550ab6e21454 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:26.986417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ebc81e2e-a2e2-46a9-b142-550ab6e21454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:26.997351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 33/64] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:27.040968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.170160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 10 11:46:27.360568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2c1e-e449-4170-bb21-bc9fcaadbf67 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.361245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2c1e-e449-4170-bb21-bc9fcaadbf67 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.361724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2c1e-e449-4170-bb21-bc9fcaadbf67 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.363385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 34/66] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:27.380119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.380638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.381138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.418487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:27.420581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:27.429162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2c1e-e449-4170-bb21-bc9fcaadbf67 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.626285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 33/67] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:27.630795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.690433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.734618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2c1e-e449-4170-bb21-bc9fcaadbf67 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.855440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.860060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.861076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.861538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.862022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.889176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29817cbe-099d-4518-9562-f07730ec33a4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.898408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:27.903827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:27.904713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:27.905463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:27.907823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 35/68] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:27.913907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.969447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.970497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.970982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.971451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.001966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:28.018619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:28.019523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:28.020269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:28.021326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:28.025989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.076500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381395b-93f8-4966-a82f-706ee82e913a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.121878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.122811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.123268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.123673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.124740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.125242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.127451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.140254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 36/70] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.141371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.153277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.167669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569758-ef6f-4ea0-a6f2-91b6779c8760 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.205549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57884b-7d00-40a5-b959-35686b6b8e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.206232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57884b-7d00-40a5-b959-35686b6b8e09 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.206522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57884b-7d00-40a5-b959-35686b6b8e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.206789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57884b-7d00-40a5-b959-35686b6b8e09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.218593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57884b-7d00-40a5-b959-35686b6b8e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8e57884b-7d00-40a5-b959-35686b6b8e09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:28.223590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:28.225311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:28.226985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adb32-3f26-4683-8cf0-77a99851c3bd None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.228962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adb32-3f26-4683-8cf0-77a99851c3bd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.228962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497adb32-3f26-4683-8cf0-77a99851c3bd None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.228962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 36/72] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:28.229490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adb32-3f26-4683-8cf0-77a99851c3bd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.234958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.262068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83cc79-db92-4c1e-a5e1-08f8ebe7e339 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.299285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.299905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.300187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.300473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.301142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.301447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.302885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818fad8-8daf-4c59-becc-170fd85df2f2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.311700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 37/73] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.312968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73383ad7-1f88-4dc1-914f-5ec1a13e5280 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.313255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73383ad7-1f88-4dc1-914f-5ec1a13e5280 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.313534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73383ad7-1f88-4dc1-914f-5ec1a13e5280 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.314827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 38/74] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:28.315544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73383ad7-1f88-4dc1-914f-5ec1a13e5280 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.346964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497adb32-3f26-4683-8cf0-77a99851c3bd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.383980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524438db-17ed-492e-88c2-af493bbe0223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.384887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524438db-17ed-492e-88c2-af493bbe0223 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.385236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524438db-17ed-492e-88c2-af493bbe0223 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.385675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524438db-17ed-492e-88c2-af493bbe0223 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.389199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.401981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524438db-17ed-492e-88c2-af493bbe0223 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.404531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524438db-17ed-492e-88c2-af493bbe0223 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.407578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.409405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2c14c-e0fc-42f0-b017-a8f27b6caae0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.409921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2c14c-e0fc-42f0-b017-a8f27b6caae0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.410406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2c14c-e0fc-42f0-b017-a8f27b6caae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.431662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73383ad7-1f88-4dc1-914f-5ec1a13e5280 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.433526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a1c2c14c-e0fc-42f0-b017-a8f27b6caae0 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:28.435324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a1c2c14c-e0fc-42f0-b017-a8f27b6caae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:28.479231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.479861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.480148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.480419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.481094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.481399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.482850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.491992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 39/76] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.493986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.508986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.521362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 38/77] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:28.523210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.524098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.524537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.552576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:28.554449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:28.640210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f414b6-81a6-4f1c-8b67-ad7b17144e96 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.653562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 39/78] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:28.653562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.672923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.680044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.680761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.680983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.681301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.682635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.684266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.686163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 40/79] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.691519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.815983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6d043-6cb9-4b2b-b41d-f21688dcce12 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.856783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38f1e9-dc64-460a-a604-9facd00f74ce None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.861900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.862692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.862828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.863160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.864325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.866422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.874214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 41/80] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.874214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.882745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.894982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.895700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.895893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.896138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.962491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.980990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.982538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.025369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da201d-1657-4902-ac21-bc0c86487a82 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.086692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.087636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.088114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.088532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.092946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 40/81] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:29.093821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.119402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.179597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.181221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.206843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b96ffc-1b48-410d-8b41-1840d2829bba None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.243698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.244347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.244626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.244898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.253042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.256419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:29.262001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:29.270519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 41/82] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:29.271285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.293229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 42/83] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:29.294152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.356892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.379081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01552057-49bb-45ef-863d-bfddfe8886bc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.422226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41168f85-2023-4996-8b9a-5fdd7c0f87c1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.428726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.429360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.429673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.429975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.467444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.468369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.468712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.469080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.470697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.472305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.480011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 43/84] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.480011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.515162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.516712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.518245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.594770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83bc63-03af-43d9-94d9-9c026f2c2a2b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.609690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.632577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 42/85] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:29.633750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.642717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.643718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.644172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.644623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.646510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.648659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.651422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 44/86] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.652578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.789618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9104f55-b0d9-4ad8-b928-9b648ab6dd5d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.805712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c26a-6ac4-443c-82fc-cda30b509fde None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.807435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.838938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.839559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.839840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.840127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.840828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:29.841172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.842600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.852025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.852271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 43/87] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.852764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.853041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.853181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.853305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.857988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.860558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.868278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 45/88] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.868278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.912575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.973820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54afc-0974-4d10-b3e8-23d926e3acc4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.978644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28a15c-7066-45e4-8218-dc1e2b3f0cf0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.012717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.013561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.013997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.014315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.015205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=f10b830c5b1b4b53ac81d5dad7ab55a2) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:30.015544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.017082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.019225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.020234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.020700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.021160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.023278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.026528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.029738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 46/89] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:30.033938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 44/90] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/role_assignments?user.id=f10b830c5b1b4b53ac81d5dad7ab55a2&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:30.034181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.034299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.086706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:30.199580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094f6f6-bf8e-4db7-af4e-e97b4c8be5fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.222056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ac7f-55be-4643-941f-5094dd910c9f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.238282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:30.255354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.256628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.256628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.256628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.257170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.258701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.274498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.275221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.275502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.275794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.277073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.278626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.280313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 45/91] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:30.281113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.341946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 47/92] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:30 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:30.343218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.462315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b618-649e-4576-b7d6-e27a48df7cc5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.513070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.514359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.514679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.517879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.517879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=8fe6fac414db46e48e059a12469c4bfd) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:30.517879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.518306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.526589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 46/93] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/role_assignments?user.id=8fe6fac414db46e48e059a12469c4bfd&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:30.527922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.548918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:30.563548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c44d-a86e-478d-9a13-469b01998d6e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.591351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:30.659290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.661650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.661650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.661650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.661650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] RBAC: Adding query filter params (role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=f10b830c5b1b4b53ac81d5dad7ab55a2) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:30.661650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.664313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.679688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 48/94] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/role_assignments?user.id=f10b830c5b1b4b53ac81d5dad7ab55a2&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:30.730360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5272b2d-7884-4104-aba5-c3a2b57264e1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.836613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.838206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.838995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.839722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.979228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.982015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:31.065458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:31.182873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 47/95] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:31.191657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:31.393302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84dab-ac84-4365-be93-bfa0d8f2c3cf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:31.467827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41db84-d596-48ec-aab3-c360434f55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:31.468893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41db84-d596-48ec-aab3-c360434f55e5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.469389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41db84-d596-48ec-aab3-c360434f55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.469973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41db84-d596-48ec-aab3-c360434f55e5 None admin] PATH_INFO: `/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.472080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41db84-d596-48ec-aab3-c360434f55e5 None admin] RBAC: Authorizing `identity:get_project(project_id=eee7cd7cf79d4b4a96c8b6c42d94bb78)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:31.474850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41db84-d596-48ec-aab3-c360434f55e5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:31.478447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 49/96] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:31 2022] GET /identity/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:31.488068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:31.717812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1278e-a8af-4017-9b1e-79a4bb14255a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:31.783778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:31.784785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.785280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.785774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.787162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=eee7cd7cf79d4b4a96c8b6c42d94bb78, user.id=f10b830c5b1b4b53ac81d5dad7ab55a2) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:31.787711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:31.790654 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c6534-fc38-48ca-a861-06ce81cd2c9f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:31.801433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 48/97] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:31 2022] GET /identity/v3/role_assignments?user.id=f10b830c5b1b4b53ac81d5dad7ab55a2&scope.project.id=eee7cd7cf79d4b4a96c8b6c42d94bb78&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:33.657578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe906-6b45-413e-ab4c-4a26585aa5c5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.658976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe906-6b45-413e-ab4c-4a26585aa5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.659645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe906-6b45-413e-ab4c-4a26585aa5c5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.662645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 50/98] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:33.669114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.670540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.671365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.686463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.705777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:33.707837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:33.785549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831b70e-fae3-4163-ad36-5e85247078d8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.786091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831b70e-fae3-4163-ad36-5e85247078d8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.786594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831b70e-fae3-4163-ad36-5e85247078d8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.789648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 51/99] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:33.796375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.796845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.797337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.839704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:33.842138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:33.885878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 49/100] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:33.890152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.971122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 52/101] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:34.301401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.442929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb89489-293f-4284-bf9a-d68de471c397 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:34.517300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:34.518383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.518896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.519365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.522145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:34.533590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:34.538661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:34.545328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:34.546989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 50/102] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:34.552774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.703775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31b25-75bb-49b4-96a9-7665b96b9e8e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:34.750877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:34.751503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.751773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.752045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.752725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:34.753028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:34.754474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c3f64-581c-48e7-9ff8-ee892986f222 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:34.768955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 53/103] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:34.774586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.812419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa83a-ae14-456d-a675-828771f998a8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.812802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa83a-ae14-456d-a675-828771f998a8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.813036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4aa83a-ae14-456d-a675-828771f998a8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.814248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 54/104] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:34.822670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.823049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.823283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.854420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:34.855642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:34.883734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:34.947661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 55/105] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:34.948552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.988250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08aa41-b59c-40c9-a3c8-00deec3d7405 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.059326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.059980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.060264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.060651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.066818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.067431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad099d9-7651-4ddb-9844-2c2756b52970 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.068340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.070629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 51/106] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:35.089495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.113294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.114050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.114343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.114670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.128248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:35.133982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:35.135574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:35.137048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 56/107] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:35.141904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.157451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.249176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.269189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c609-303a-444d-888d-d11e99246ac0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.309349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.310068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.310353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.310677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.311401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:35.311669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.313093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.322948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 57/108] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:35.329217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.343714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230694c9-fc91-4d2e-a1b0-8501df447ae0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.412328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.430786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.431453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.431736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.432001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.433331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.434844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.437512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 52/109] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:35.459010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.468759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9319df-3417-41a5-872b-a080a9dcac3b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.517423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.518443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.518888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.519343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.521052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.523021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.525183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 58/110] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:35.535552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.674152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063ff21-f079-4be4-b31b-394450fefe73 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.745802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.757874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d427e-a6a7-42b9-9286-610940cd5895 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.758506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.759935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.760375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.762013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2/users/8fe6fac414db46e48e059a12469c4bfd/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.771397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e0239b8ed2442892410300591841f2, user_id=8fe6fac414db46e48e059a12469c4bfd, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.775544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.802542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848108b-009e-4927-9ea4-43a26e279ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.803262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848108b-009e-4927-9ea4-43a26e279ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.803601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848108b-009e-4927-9ea4-43a26e279ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.803963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848108b-009e-4927-9ea4-43a26e279ab0 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.806083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848108b-009e-4927-9ea4-43a26e279ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.807691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848108b-009e-4927-9ea4-43a26e279ab0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.809480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 59/111] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:35.810780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea97b-79bb-4e75-9b03-ff1ee46e5521 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.811073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea97b-79bb-4e75-9b03-ff1ee46e5521 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.811349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ea97b-79bb-4e75-9b03-ff1ee46e5521 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.812983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 60/112] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:35.813905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c560c65-c62e-450b-9450-d1f2b4c8795c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.814197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c560c65-c62e-450b-9450-d1f2b4c8795c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.814479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c560c65-c62e-450b-9450-d1f2b4c8795c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.818103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 61/113] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:35.818103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c560c65-c62e-450b-9450-d1f2b4c8795c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.829641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.848576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 53/114] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:35 2022] PUT /identity/v3/projects/a3e0239b8ed2442892410300591841f2/users/8fe6fac414db46e48e059a12469c4bfd/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:35.849835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.965284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c560c65-c62e-450b-9450-d1f2b4c8795c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.002554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43c474-0dd3-42df-a623-bf080aa290a6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.010038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502f27f-f8f3-4280-b6cd-74ee8f24689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.010701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502f27f-f8f3-4280-b6cd-74ee8f24689d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.010982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502f27f-f8f3-4280-b6cd-74ee8f24689d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.011262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502f27f-f8f3-4280-b6cd-74ee8f24689d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.025744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502f27f-f8f3-4280-b6cd-74ee8f24689d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0502f27f-f8f3-4280-b6cd-74ee8f24689d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:36.031415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:36.032981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:36.033767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 62/115] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:36.042164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667977f-6f18-4381-a0f9-593a4c5d890f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.042164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667977f-6f18-4381-a0f9-593a4c5d890f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.042164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667977f-6f18-4381-a0f9-593a4c5d890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.055732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed383ca-bbc2-424e-a53f-fa41e604d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.056481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed383ca-bbc2-424e-a53f-fa41e604d81a None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.056796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed383ca-bbc2-424e-a53f-fa41e604d81a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.057079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed383ca-bbc2-424e-a53f-fa41e604d81a None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2/users/f10b830c5b1b4b53ac81d5dad7ab55a2/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.059172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed383ca-bbc2-424e-a53f-fa41e604d81a None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e0239b8ed2442892410300591841f2, user_id=f10b830c5b1b4b53ac81d5dad7ab55a2, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.060675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed383ca-bbc2-424e-a53f-fa41e604d81a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.063381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e667977f-6f18-4381-a0f9-593a4c5d890f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:36.065272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e667977f-6f18-4381-a0f9-593a4c5d890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:36.133352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.141835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 63/116] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:36.143381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc31e-353d-4366-9850-e6b72b18a3d2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.143757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc31e-353d-4366-9850-e6b72b18a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.144121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc31e-353d-4366-9850-e6b72b18a3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.165397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-99dbc31e-353d-4366-9850-e6b72b18a3d2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:36.169731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99dbc31e-353d-4366-9850-e6b72b18a3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:36.184684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 54/117] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:35 2022] PUT /identity/v3/projects/a3e0239b8ed2442892410300591841f2/users/f10b830c5b1b4b53ac81d5dad7ab55a2/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:36.188879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a872be-cef0-4431-b16f-2394fa2f660b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.190209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a872be-cef0-4431-b16f-2394fa2f660b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.191095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a872be-cef0-4431-b16f-2394fa2f660b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.194327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 55/118] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:36.196745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a872be-cef0-4431-b16f-2394fa2f660b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.310270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 64/119] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:36.312678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.313156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.313637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.319659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.342630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:36.344770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:36.429899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a872be-cef0-4431-b16f-2394fa2f660b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.479225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 65/120] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:36.513637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.515007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.515662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.516284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.517646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:36.518420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.521223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.537765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 56/121] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:36.547760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.608776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.661884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.752410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e7d03-e73b-401e-967d-a5097a55f9bb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.834810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.836276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.836276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.836554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.837754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.840927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.842941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 66/122] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:36.843742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.857887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d20a0a-5f23-4827-9d9f-54e34dbc328d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.907160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.953367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.955286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.955748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.956263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.977945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:36.989596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:36.991293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:36.992844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 57/123] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:36.994093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.035867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106297ee-2190-4bea-9e3c-5a1c3b874b6e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.095771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.128657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.129484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.130180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.130596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.132094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.135900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.137925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 67/124] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:37.138932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.196816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc474b3-ddb5-448e-aa84-eb8775efe17e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.255470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.257119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.257119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.257380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.259345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.262078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.269902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 58/125] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:37.269902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.344960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.367662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8cf2c-ffe4-4d4b-b839-91cb68f55b89 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.418243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.418875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.419160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.419440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.420144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:37.420456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.421943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.432730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 68/126] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:37.433605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.486307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0d14-afd9-4f7a-be3f-38c5e4658530 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.550724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.554268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.556063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.556735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.557218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.580676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:37.592262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:37.594124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:37.595737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:37.598431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 59/127] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:37.600951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.655458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c90a5-4fc5-4cee-9c5b-59199089e140 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.731772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.733835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.734675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.735401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.737039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.740904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.792028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.795766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2768-bcc6-4f4d-ac0e-d8763fcbbe58 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.840775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.841423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.841711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.842029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2/users/f10b830c5b1b4b53ac81d5dad7ab55a2/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.842583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 69/128] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:46:37 2022] POST /identity/v3/projects => generated 302 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:37.844527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e0239b8ed2442892410300591841f2, user_id=f10b830c5b1b4b53ac81d5dad7ab55a2, role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.845496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.846099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.949593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 60/129] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:37 2022] PUT /identity/v3/projects/a3e0239b8ed2442892410300591841f2/users/f10b830c5b1b4b53ac81d5dad7ab55a2/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:37.954599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.092774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66cfc9-0776-4b79-8d6f-5c99407239e2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.109449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.169251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.171122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.172060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.172844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.175366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.181339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.183333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 70/130] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.198424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.228684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6004d-5aab-4503-af54-ec8387b8d9c1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.335449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.336133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.336422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.336693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.337386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:38.337690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.339157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.363984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 61/131] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.367465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3121ff-4016-4834-a297-8cd87cd7ac65 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.370550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.408391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.409045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.409333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.409617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] PATH_INFO: `/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.415206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] RBAC: Authorizing `identity:get_project(project_id=eee7cd7cf79d4b4a96c8b6c42d94bb78)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.416978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.418781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 71/132] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.426849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.474523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.530448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.566998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eb23e-54c2-43ab-9bec-4b5d9ec52166 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.607962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc39eb1-7b72-4d70-a61f-9cf06cc59fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.608644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc39eb1-7b72-4d70-a61f-9cf06cc59fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.608931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc39eb1-7b72-4d70-a61f-9cf06cc59fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.609213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc39eb1-7b72-4d70-a61f-9cf06cc59fd0 None admin] PATH_INFO: `/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78/users/f10b830c5b1b4b53ac81d5dad7ab55a2/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.611587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc39eb1-7b72-4d70-a61f-9cf06cc59fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eee7cd7cf79d4b4a96c8b6c42d94bb78, user_id=f10b830c5b1b4b53ac81d5dad7ab55a2, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.613201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc39eb1-7b72-4d70-a61f-9cf06cc59fd0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.689322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4a6f9-3a02-493f-8971-6f061864a39b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.693200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 72/133] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:38 2022] PUT /identity/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78/users/f10b830c5b1b4b53ac81d5dad7ab55a2/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:38.697141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280ea5-1ea2-4c69-a851-cb8aadcf817d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.697443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280ea5-1ea2-4c69-a851-cb8aadcf817d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.697784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280ea5-1ea2-4c69-a851-cb8aadcf817d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.699645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 73/134] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:38.705622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a81d8-bca3-4f28-a738-c7f7295ba5f6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.708827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a81d8-bca3-4f28-a738-c7f7295ba5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.709330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a81d8-bca3-4f28-a738-c7f7295ba5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.764556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-577a81d8-bca3-4f28-a738-c7f7295ba5f6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:38.767174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-577a81d8-bca3-4f28-a738-c7f7295ba5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:38.784881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.785736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.786159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.786462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] PATH_INFO: `/v3/users/7f3ef36211e441b8b6521b60353bfc08` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.814592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] RBAC: Authorizing `identity:get_user(user_id=7f3ef36211e441b8b6521b60353bfc08)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.816187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.818051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 62/135] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/users/7f3ef36211e441b8b6521b60353bfc08 => generated 289 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.824047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.942142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 74/136] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:38.998102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.037750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84a7ef-6859-46b8-aee5-9d6c522c8960 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:39.113092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:39.114601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:39.115421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:39.116198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:39.266004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:39.269200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:39.428507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.487549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 63/137] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:39.491838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cfdb7-041f-48cc-9b25-8257b2e729b0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:39.493041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cfdb7-041f-48cc-9b25-8257b2e729b0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:39.493671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cfdb7-041f-48cc-9b25-8257b2e729b0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:39.496483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 75/138] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:39.498201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:39.508995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:39.509631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:39.510226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:39.571214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:39.573187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:39.643754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.739961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 76/139] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:39.741170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:39.744257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47873b9-f02a-49c5-90b2-408e5ff591f7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:39.798197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:39.798859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:39.799143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:39.799425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:39.800631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:39.802337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:39.804084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 64/140] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:39 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:39.813919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:39.950332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.985416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eb328-d6e0-458f-8bc1-44c9a45664f7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:40.106834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:40.107890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:40.108359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:40.108829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:40.130039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a7287-eddc-4cc1-a0e7-f7003c703c1d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:40.150633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:40.164748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:40.166486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:40.168092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 77/141] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:40.176865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:40.249129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:40.273440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:40.274501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:40.274987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:40.275445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:40.276593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] RBAC: Adding query filter params (role.id=7e54d4ac514741edb1b29ae85265d7ad, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=7f3ef36211e441b8b6521b60353bfc08) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:40.278803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:40.280036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:40.309386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 65/142] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:39 2022] GET /identity/v3/role_assignments?user.id=7f3ef36211e441b8b6521b60353bfc08&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=7e54d4ac514741edb1b29ae85265d7ad => generated 259 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:40.388439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:40.426563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b788c-7ed1-47b5-a52f-a2130c2f8fd3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:40.537055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:40.538687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:40.539485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:40.540225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:40.541807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:40.542643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:40.545628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:40.575141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 78/143] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:40.585152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:40.765935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305c42e-a5a4-4434-aa7b-eebb7900b5bd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:40.806383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:40.881233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:40.882482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:40.882996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:40.883502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:40.905203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:40.931335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:40.941881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:40.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:40.946509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:40.955085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 66/144] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 567 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:40.967923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20d007-dbbc-43a6-9fed-bbd889bec183 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:40.972607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:41.075184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:41.076327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:41.076650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:41.077115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] PATH_INFO: `/v3/users/8fe6fac414db46e48e059a12469c4bfd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:41.079230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe6fac414db46e48e059a12469c4bfd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:41.081896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:41.084979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 79/145] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:40 2022] GET /identity/v3/users/8fe6fac414db46e48e059a12469c4bfd => generated 247 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:41.094384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:41.333804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330761-5f98-41e4-acfa-f9d9daaea6d7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:41.394551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e565a4-12d9-4dc5-b9d7-3884a8348881 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:41.460533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:41.460533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:41.464982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:41.464982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:41.464982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:41.465488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:41.468499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:41.502238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 67/146] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:41.513408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:41.530683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:41.531323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:41.531645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:41.531886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:41.604941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:41.639514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:41.791501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:41.794333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:41.820695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872305-ea2a-4c20-884a-7aefd9da54c2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:41.875444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:41.875995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:41.876281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:41.876560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:41.883361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:41.884841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:41.886560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 68/147] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:41 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:41.895883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.067042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b9797-5898-45d4-9375-243aeba352c0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.068777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.104359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e05ca-bb2c-4232-90ed-921a52c66e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.104994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e05ca-bb2c-4232-90ed-921a52c66e7f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.105291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e05ca-bb2c-4232-90ed-921a52c66e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.105560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e05ca-bb2c-4232-90ed-921a52c66e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.120584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 80/148] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1027 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:42.126465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.181752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e05ca-bb2c-4232-90ed-921a52c66e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.183383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e05ca-bb2c-4232-90ed-921a52c66e7f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.233609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.348896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecdaf4-86db-4197-9f9c-3d1bccd28c81 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.396764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 69/149] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:42.398580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56d963-f511-496b-a989-2dc68e8e5f92 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.398876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56d963-f511-496b-a989-2dc68e8e5f92 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.399153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56d963-f511-496b-a989-2dc68e8e5f92 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.400681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 70/150] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:42.401747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc674b-074e-46da-ae85-c6f3da754d2a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.402054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc674b-074e-46da-ae85-c6f3da754d2a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.402333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc674b-074e-46da-ae85-c6f3da754d2a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.403522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 71/151] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:42.412085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc674b-074e-46da-ae85-c6f3da754d2a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.417594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.419468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe07ab5-a5a1-49b5-9c96-b5a34945e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.420110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe07ab5-a5a1-49b5-9c96-b5a34945e98c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.420388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe07ab5-a5a1-49b5-9c96-b5a34945e98c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.420661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe07ab5-a5a1-49b5-9c96-b5a34945e98c None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.421825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe07ab5-a5a1-49b5-9c96-b5a34945e98c None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.423303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe07ab5-a5a1-49b5-9c96-b5a34945e98c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.425255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 81/152] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:42.426561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492142e6-0139-446c-88e4-c99fd74491af None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.426900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492142e6-0139-446c-88e4-c99fd74491af None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.427046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492142e6-0139-446c-88e4-c99fd74491af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.446562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-492142e6-0139-446c-88e4-c99fd74491af None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:42.447798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-492142e6-0139-446c-88e4-c99fd74491af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:42.559853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 82/153] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:42.570332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.572773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.573568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.591638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc674b-074e-46da-ae85-c6f3da754d2a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.627078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:42.628345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:42.688772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.690530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.691290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.692028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.695310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.698657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.703454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 72/154] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:42.710928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.741086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.765597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 83/155] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:42.766503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.912878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56ba8-4ccc-4660-af29-0a3dff0e1e5d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.932462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.952957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.953594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.953931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.954201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.955675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=f10b830c5b1b4b53ac81d5dad7ab55a2) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:42.955992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.957485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d73fa-6bb5-44cf-9edc-c2161d6d4099 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.974150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 84/156] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/role_assignments?user.id=f10b830c5b1b4b53ac81d5dad7ab55a2&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:42.975459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659da03-42e9-40f1-b3aa-2e5146a1cec8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.975746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659da03-42e9-40f1-b3aa-2e5146a1cec8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.976815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659da03-42e9-40f1-b3aa-2e5146a1cec8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.978140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 85/157] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:42.988587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.988921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.989143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.002079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f570cb-7852-43d9-b8d3-eb747a5be673 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.032382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:43.033623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:43.092856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.093490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.093772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.094082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.094834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=8fe6fac414db46e48e059a12469c4bfd) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:43.095147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.096667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.104925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 73/158] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/role_assignments?user.id=8fe6fac414db46e48e059a12469c4bfd&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:43.110596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.166077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.238672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 86/159] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:43.291084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568452b7-a419-4290-a0b7-b85b9233bd57 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.342545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.343613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.344103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.344607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.347537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.360223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:43.365542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:43.366524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:43.367971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:43.373481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.376178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 74/160] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:43.401617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.559255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71016f-97da-4278-8a74-06338f78cffd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.612267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.612889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.613163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.613434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.614175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:43.614474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.615896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.625327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 87/161] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:43.632082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.650813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa3be-b0ed-48cf-8317-b701239ba10c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.673312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.723922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.725633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.727215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.728022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.730503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.733869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.736436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 75/162] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:43.737331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.769779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c6bc-b61a-4992-bdd8-cd9f21f368ef None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.817916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.827256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.832255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.832255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.832255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.832255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.832255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.839220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 88/163] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:43.839220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.861836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71edd2-2b3d-40ed-a02f-64d8a0de5aa9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.900670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c080c-c2de-41f0-a278-e0626a60bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.901313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c080c-c2de-41f0-a278-e0626a60bc0c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.901585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c080c-c2de-41f0-a278-e0626a60bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.901895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c080c-c2de-41f0-a278-e0626a60bc0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.913010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c080c-c2de-41f0-a278-e0626a60bc0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-9b6c080c-c2de-41f0-a278-e0626a60bc0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:43.918738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:43.920310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 76/164] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:43.922434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f37ed-d538-4b74-be74-dd077c4946ad None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.930423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f37ed-d538-4b74-be74-dd077c4946ad None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.930423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f37ed-d538-4b74-be74-dd077c4946ad None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.930423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 77/165] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:43.930423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f37ed-d538-4b74-be74-dd077c4946ad None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.953387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b34a6a-4aba-4904-9f5a-202d328186df None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.957197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.996556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.997169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.997442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.997716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.998416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.000201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.042933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f37ed-d538-4b74-be74-dd077c4946ad None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.066795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.079138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.079688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.079967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.080342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.088448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 89/166] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:43 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:44.089560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.198237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.200778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.255396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71ffce-5bdb-44cb-ac00-dc9612a9d463 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.311685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.312723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.313117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.313562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.314804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:44.315301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.317790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9135-0886-4551-ae07-9f7aa3bce9b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.337990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 90/167] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:44.337990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.337990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.337990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.347641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 78/168] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:44.349355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.362878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:44.364084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:44.386357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.393543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.472335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 91/169] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:44.473558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.518467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64023c2-f86f-4d0d-bc71-b99528c490f7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.570837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.572081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.572628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.573216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] PATH_INFO: `/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.575761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] RBAC: Authorizing `identity:get_user(user_id=f10b830c5b1b4b53ac81d5dad7ab55a2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.578827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.582231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 79/170] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/users/f10b830c5b1b4b53ac81d5dad7ab55a2 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:44.590412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.615317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae3d6a-2e7e-48f5-a7af-e14674179dc7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.665943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.667220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.667703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.668188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.672661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.674436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.676420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 92/171] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:44.684048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.725615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.732571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.747474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4795-0555-4170-a4a4-1290822082b6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.796675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.797303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.797598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.798006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.858496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b52e4-a7aa-4ace-aec1-d8deccb84397 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.904465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.905259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.905540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.905813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.906600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] RBAC: Adding query filter params (role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=f10b830c5b1b4b53ac81d5dad7ab55a2) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:44.906911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.908729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.909276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.912039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.915882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 93/172] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/role_assignments?user.id=f10b830c5b1b4b53ac81d5dad7ab55a2&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:44.917177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:45.055300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:45.067245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:45.080931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94c167-2f2f-4e53-bce8-6f0bab5ea97b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:45.081910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 80/173] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:45.089182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:45.137101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:45.137683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.139879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.139879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.164442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:45.171404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:45.172342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:45.173124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:45.175661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 94/174] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:45.182474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:45.303375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b58bf8-5f98-40dc-ba69-397ef379063a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:45.320289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada228-37c9-42b6-a262-6a73aa933ede None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:45.367945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:45.369085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.369659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.370171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.370543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:45.371478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.371757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:45.371865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.372252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] PATH_INFO: `/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.372791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:45.374238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] RBAC: Authorizing `identity:get_project(project_id=eee7cd7cf79d4b4a96c8b6c42d94bb78)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:45.375157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:45.377071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:45.382848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 81/175] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:45 2022] GET /identity/v3/projects/eee7cd7cf79d4b4a96c8b6c42d94bb78 => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:45.386894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 95/176] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:45.391618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:45.394639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:45.426402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:45.540991 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:45.594146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692f66-7e9a-40cf-a538-e0e53b5399db None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:45.647414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd276e7-b014-465e-b5c4-e0431645c593 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:45.653570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:45.654277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.654554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.654878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.655624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=eee7cd7cf79d4b4a96c8b6c42d94bb78, user.id=f10b830c5b1b4b53ac81d5dad7ab55a2) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:45.655937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:45.657427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:45.669548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 82/177] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:45 2022] GET /identity/v3/role_assignments?user.id=f10b830c5b1b4b53ac81d5dad7ab55a2&scope.project.id=eee7cd7cf79d4b4a96c8b6c42d94bb78&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:45.710189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:45.711401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.711678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.711950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] PATH_INFO: `/v3/users/7f3ef36211e441b8b6521b60353bfc08` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.718640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] RBAC: Authorizing `identity:get_user(user_id=7f3ef36211e441b8b6521b60353bfc08)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:45.720275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:45.722389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 96/178] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:45 2022] GET /identity/v3/users/7f3ef36211e441b8b6521b60353bfc08 => generated 289 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:45.731971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:45.923311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a24432-20b8-4657-9f63-0df61a71dfc6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:45.948886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:45.962153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b558e-328d-4160-9355-cac02de4a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:45.963163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b558e-328d-4160-9355-cac02de4a40e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.963638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b558e-328d-4160-9355-cac02de4a40e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.964112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b558e-328d-4160-9355-cac02de4a40e None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.965574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b558e-328d-4160-9355-cac02de4a40e None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:45.967373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b558e-328d-4160-9355-cac02de4a40e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:45.969357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 83/179] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:45 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:45.975445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.062990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.092317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c1067-cd3b-42e3-a497-19c9cf34798d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:46.132789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2828dd-c526-490e-9f02-548d012949fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:46.133821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2828dd-c526-490e-9f02-548d012949fd None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:46.134339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2828dd-c526-490e-9f02-548d012949fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:46.134808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2828dd-c526-490e-9f02-548d012949fd None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2/users/7f3ef36211e441b8b6521b60353bfc08/roles/7e54d4ac514741edb1b29ae85265d7ad` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:46.137025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2828dd-c526-490e-9f02-548d012949fd None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e0239b8ed2442892410300591841f2, user_id=7f3ef36211e441b8b6521b60353bfc08, role_id=7e54d4ac514741edb1b29ae85265d7ad)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:46.138743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2828dd-c526-490e-9f02-548d012949fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:46.209739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 97/180] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:45 2022] PUT /identity/v3/projects/a3e0239b8ed2442892410300591841f2/users/7f3ef36211e441b8b6521b60353bfc08/roles/7e54d4ac514741edb1b29ae85265d7ad => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:47.049624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fb17-465e-4301-89a2-41c26dc67f2d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.050204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fb17-465e-4301-89a2-41c26dc67f2d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.050204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49fb17-465e-4301-89a2-41c26dc67f2d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.051811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 84/181] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:47.057650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85463447-e9c8-4495-9f1f-aecc77954035 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.058186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85463447-e9c8-4495-9f1f-aecc77954035 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.058285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85463447-e9c8-4495-9f1f-aecc77954035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.080103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-85463447-e9c8-4495-9f1f-aecc77954035 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:47.082256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-85463447-e9c8-4495-9f1f-aecc77954035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:47.191662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 98/182] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:47.508912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703be71-a0fc-4740-8105-2613cab37caf None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.509236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703be71-a0fc-4740-8105-2613cab37caf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.509466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703be71-a0fc-4740-8105-2613cab37caf None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.511144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 85/183] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:47.517034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703be71-a0fc-4740-8105-2613cab37caf None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.518036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db029a90-09bd-4891-b12f-beeafbb2828e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.521080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db029a90-09bd-4891-b12f-beeafbb2828e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.521080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db029a90-09bd-4891-b12f-beeafbb2828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.546540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-db029a90-09bd-4891-b12f-beeafbb2828e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:47.548448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-db029a90-09bd-4891-b12f-beeafbb2828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:47.626746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.636306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 99/184] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:47.637488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b69f-aa71-40b5-8e90-3f517c6873f4 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.637772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b69f-aa71-40b5-8e90-3f517c6873f4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.638082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b69f-aa71-40b5-8e90-3f517c6873f4 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.639495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 100/185] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:47.645010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.645368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.646695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.665237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703be71-a0fc-4740-8105-2613cab37caf None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.667441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:47.671576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:47.715165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.716091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.716548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.717002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.733968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:47.741283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:47.742874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:47.743636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:47.751761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 86/186] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:47.753254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.789802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 101/187] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:47.824044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.889842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2050c23-9dc7-4360-bc3b-a60fef19bdc1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.931605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.932246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.932530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.932804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.933488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:47.933792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.935288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.945736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 87/188] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:47.946319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.963225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.072743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32e671-35e4-449f-9b81-0c426e150e58 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.094968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc9af0-23c1-4092-93f0-86f25bc2382d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.111242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.111892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.125327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.126040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.126323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.126597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.127783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.129246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.132119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 102/189] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.137808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.149050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.156283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.156283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.156283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] PATH_INFO: `/v3/users/c897e31d8f364522a595387b98e0c0f1` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.175014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] RBAC: Authorizing `identity:get_user(user_id=c897e31d8f364522a595387b98e0c0f1)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.177530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.180443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 88/190] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/users/c897e31d8f364522a595387b98e0c0f1 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.189228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.310334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394f3eb-c343-4335-bec8-23b7f0c85cb8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.324721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653eb3-2cad-4756-9d82-056266cc5224 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.364458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.365373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.365906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.366437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.367667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.370892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.388843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989be3f0-f41b-472c-af1e-b5a8987f76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.389785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be3f0-f41b-472c-af1e-b5a8987f76b0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.390379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be3f0-f41b-472c-af1e-b5a8987f76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.390807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989be3f0-f41b-472c-af1e-b5a8987f76b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.464500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.517882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 103/191] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:48 2022] POST /identity/v3/users => generated 297 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:48.517882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.521446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989be3f0-f41b-472c-af1e-b5a8987f76b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.523482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989be3f0-f41b-472c-af1e-b5a8987f76b0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.630086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.736116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d058ab4-2331-4e46-83c6-7facfe685c14 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.750046 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 89/192] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:48.752290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b2220-5589-44be-b206-ab8b36284e87 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.752700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b2220-5589-44be-b206-ab8b36284e87 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.752849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b2220-5589-44be-b206-ab8b36284e87 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.755010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 90/193] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:48.760264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b2220-5589-44be-b206-ab8b36284e87 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.805310 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3ad8c-d839-4bfc-a2bd-a78b8e71cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.806002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ad8c-d839-4bfc-a2bd-a78b8e71cdbc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.806277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ad8c-d839-4bfc-a2bd-a78b8e71cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.806558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ad8c-d839-4bfc-a2bd-a78b8e71cdbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.820178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3ad8c-d839-4bfc-a2bd-a78b8e71cdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-15a3ad8c-d839-4bfc-a2bd-a78b8e71cdbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:48.825887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:48.827622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 104/194] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:48.829185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.832274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.832274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.861229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:48.863440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:48.876382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.939071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b2220-5589-44be-b206-ab8b36284e87 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.986164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 105/195] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:48.987497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.034415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.035451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.035935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.036508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.042226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.048517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.055693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 91/196] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.065829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.114406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.313312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd885ed-88b1-4e6b-b4e5-bbc1a996381d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.341569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3c6d-d987-4aad-895f-df71b1927a0f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.381683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f10cb-0260-4908-983a-e10202da705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.382996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f10cb-0260-4908-983a-e10202da705f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.384910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f10cb-0260-4908-983a-e10202da705f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.385435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f10cb-0260-4908-983a-e10202da705f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.388028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f10cb-0260-4908-983a-e10202da705f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.392492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f10cb-0260-4908-983a-e10202da705f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.394384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f10cb-0260-4908-983a-e10202da705f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.409513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 106/197] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.423206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f10cb-0260-4908-983a-e10202da705f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.453122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.454155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.454643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.455107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.456417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=c897e31d8f364522a595387b98e0c0f1) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.456949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.459363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.484828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 92/198] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/role_assignments?user.id=c897e31d8f364522a595387b98e0c0f1&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.534070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.538635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.632935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.638825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f10cb-0260-4908-983a-e10202da705f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.701720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.702442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.702719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.702990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] PATH_INFO: `/v3/users/c897e31d8f364522a595387b98e0c0f1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.704343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c897e31d8f364522a595387b98e0c0f1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.705824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.707743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 107/199] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/users/c897e31d8f364522a595387b98e0c0f1 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:49.713496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.729268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889ffa-bd05-46a5-82c7-eee597d37c8b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.804797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.806252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.806977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.807694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.835383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:49.846191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:49.847896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:49.849520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:49.854412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 93/200] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:49.864007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.874157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bdeef-727b-4e97-828f-3ef4479509b2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.940084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.940894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.940894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.941114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.990515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.995472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.046650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.048128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.087645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b08ac-a7d7-4622-89bc-c6335e7f02c7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.191456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.192006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.192290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.192573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.193264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.193575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.195588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.230884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 94/201] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.251729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.375934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 108/202] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:50.389770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.516092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cc08b-7ac2-4a39-8a8b-9ad9002fb964 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.537955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.572442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.593754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52226bb-2c99-40e6-b648-de6a2693ac32 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.608400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.609432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.609949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.610442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] PATH_INFO: `/v3/users/7f3ef36211e441b8b6521b60353bfc08` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.619318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] RBAC: Authorizing `identity:get_user(user_id=7f3ef36211e441b8b6521b60353bfc08)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.622216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.625616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 95/203] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/users/7f3ef36211e441b8b6521b60353bfc08 => generated 289 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.637705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.638456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.638711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.638949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.639548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.640208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.641725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.643741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 109/204] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.650316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.762617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852bd43-f176-4342-8f0e-f312641c007b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.828033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.828661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.828939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.829209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.829975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] RBAC: Adding query filter params (role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=c897e31d8f364522a595387b98e0c0f1) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.830308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.831905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.836851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.838733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 110/205] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/role_assignments?user.id=c897e31d8f364522a595387b98e0c0f1&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:50.922721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d6096-1349-4854-afc8-6770e42bfa78 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.988907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.989563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.989870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.992660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.084469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.096310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.109563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.304868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 96/206] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:51.315008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.440274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfaa12-34a1-49f8-ae91-8bc050e23e16 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.482666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83873fa3-db5c-4ca5-8598-883a052a45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.483332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873fa3-db5c-4ca5-8598-883a052a45ce None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.483611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873fa3-db5c-4ca5-8598-883a052a45ce None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.483885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83873fa3-db5c-4ca5-8598-883a052a45ce None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.485190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873fa3-db5c-4ca5-8598-883a052a45ce None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.486826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83873fa3-db5c-4ca5-8598-883a052a45ce None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.488810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 111/207] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:51 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:51.498523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.657898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c113f3-b6c4-4b53-9cc9-944dc5f90fbe None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.657898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c113f3-b6c4-4b53-9cc9-944dc5f90fbe None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.657898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c113f3-b6c4-4b53-9cc9-944dc5f90fbe None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.659099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 112/208] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:51.677366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7792f3e-3837-4c38-8a1f-8660ffcdd14f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.677827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7792f3e-3837-4c38-8a1f-8660ffcdd14f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.678322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7792f3e-3837-4c38-8a1f-8660ffcdd14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.723510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a7792f3e-3837-4c38-8a1f-8660ffcdd14f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:51.725441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a7792f3e-3837-4c38-8a1f-8660ffcdd14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:51.766849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.805627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bd949-81f7-47c8-876c-c09b2cda5ccd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.850647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.851767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.852041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.852336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.853053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] RBAC: Adding query filter params (role.id=7e54d4ac514741edb1b29ae85265d7ad, scope.project.id=a3e0239b8ed2442892410300591841f2, user.id=7f3ef36211e441b8b6521b60353bfc08) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:51.853365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.855026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.867104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 97/209] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:51 2022] GET /identity/v3/role_assignments?user.id=7f3ef36211e441b8b6521b60353bfc08&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=7e54d4ac514741edb1b29ae85265d7ad => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:51.877835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.884728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 113/210] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 10 11:46:52.369570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:52.577579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a59a52-d5d7-45ee-80e9-48ab81698747 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:52.652447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:52.653425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.653943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.654510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.680598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:52.682279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c870c-2b8f-444a-be4a-aee2833ff435 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.682714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c870c-2b8f-444a-be4a-aee2833ff435 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.682877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c870c-2b8f-444a-be4a-aee2833ff435 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.684216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 114/211] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:52.691227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcce44-024f-439c-9070-84b2a97f806b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.691543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcce44-024f-439c-9070-84b2a97f806b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:52.691644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:52.692455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:52.693220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:52.693817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcce44-024f-439c-9070-84b2a97f806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.694461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 98/212] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:52.703829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:52.722846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-97fcce44-024f-439c-9070-84b2a97f806b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:52.724797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-97fcce44-024f-439c-9070-84b2a97f806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:52.748120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:52.866331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 115/213] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:52.867934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5192dc-98db-4747-9052-b523723be740 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.868232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5192dc-98db-4747-9052-b523723be740 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.868514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5192dc-98db-4747-9052-b523723be740 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.869823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 116/214] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:52.876745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e14bdb-18f2-4464-9b0d-c0882589462d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:52.877484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.877646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.877911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.900528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:52.901784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:52.961146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:52.963047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.963781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.964508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.967035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:52.967877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:52.971888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:52.988151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 117/215] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:52.990449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 99/216] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:52.999942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.110038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.157195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.193103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67754b3-ddea-4b6f-83a6-d84a4dd2f232 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.274959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.276296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.276805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.277296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] PATH_INFO: `/v3/users/427480b88a064123a79c996a1e237092` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.299740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] RBAC: Authorizing `identity:get_user(user_id=427480b88a064123a79c996a1e237092)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.301250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.303326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 118/217] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:52 2022] GET /identity/v3/users/427480b88a064123a79c996a1e237092 => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:53.303986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.320358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.357541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf0f5d-da5d-48de-8838-b485e6d19544 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.415925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.416920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.417283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.417739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.419642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.421876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.424127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 100/218] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:53.425044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.487116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83023f-dcef-42b6-ad32-567952069683 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.513988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.535432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.536093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.536533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.536994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.549325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:53.554447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:53.556190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:53.557888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:53.560583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 119/219] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:53.561602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.606074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca337511-00a0-4cf8-af99-4802f5517dca None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.660160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.661138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.661621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.662153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.683004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.695067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4373e-b783-4b5a-a859-b35cca8d8655 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.748686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.750359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.761190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.762030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.762553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.763027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.764143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.766946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.887648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 120/220] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:53 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:53.889371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.928620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 101/221] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:53.936593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.951374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.042497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.066782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e505ffe-200a-4ab9-a223-2d2d438b8024 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.113511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.113965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.114258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.114540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.115260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:54.115570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.117899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03405d8d-2057-4cb2-8c75-06580afe2aa9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.128438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 121/222] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.130071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab257f-c417-49a8-a9a5-bdff0dd59a59 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.130422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab257f-c417-49a8-a9a5-bdff0dd59a59 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.130706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab257f-c417-49a8-a9a5-bdff0dd59a59 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.132879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 122/223] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:54.139615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.140012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.140509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.145456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494552-bf69-43b4-ab86-5572316a5b0d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.168006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:54.169947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:54.188994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.189646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.189968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.190246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.191957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.192948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.195693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 102/224] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.196628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.267268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 123/225] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:54.268162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.298372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.338214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4667-46eb-4671-971c-25bc71fcb6c4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.357131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.413313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.414206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.414597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.414978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] PATH_INFO: `/v3/users/c897e31d8f364522a595387b98e0c0f1` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.415536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15720-860a-461c-8499-7aba6ea85a89 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.416348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] RBAC: Authorizing `identity:get_user(user_id=c897e31d8f364522a595387b98e0c0f1)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.417868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.419717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 103/226] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/users/c897e31d8f364522a595387b98e0c0f1 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.430705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.487054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.488528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.489101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.489727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.491828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=427480b88a064123a79c996a1e237092) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:54.492400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.495262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.506405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 124/227] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/role_assignments?user.id=427480b88a064123a79c996a1e237092&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.611621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3b1d7-03a1-4cff-b0b7-d53c1531bc97 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.680418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.681545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.682104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.682566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.684389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.685303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.686252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.688359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 104/228] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:54.696792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.812384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.863218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.877150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9a25-d298-4627-ad42-ad461d7e6fd8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.899021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a411-b2f8-4dda-8115-abcbc04a92be None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.915207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.915855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.916131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.916405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.928589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:54.934658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:54.935582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:54.937150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 125/229] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:54.941890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.983127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.984071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.984418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.984831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/c897e31d8f364522a595387b98e0c0f1/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.990678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cd5fa546554b3d9b2281d365cb1a2c, user_id=c897e31d8f364522a595387b98e0c0f1, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.993097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.086036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 105/230] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:54 2022] PUT /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/c897e31d8f364522a595387b98e0c0f1/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:55.120034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683fb0d-2a07-4e4f-80f1-153b63ba1398 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.183949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.185045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.185492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.186019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.187354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.187894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.190375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.206142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 126/231] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:55.215902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.378229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5b1af-979e-4458-86b8-1e2dcc4029c5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.391685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.425655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.426790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.427280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.427800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] PATH_INFO: `/v3/users/c897e31d8f364522a595387b98e0c0f1` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.429444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] RBAC: Authorizing `identity:get_user(user_id=c897e31d8f364522a595387b98e0c0f1)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.431377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.437102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 106/232] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/users/c897e31d8f364522a595387b98e0c0f1 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.441464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.470245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.595978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e883a-3539-4e80-a11f-0b75b3f4ad66 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.658075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec5d0c-8cb4-403b-a607-aa213f45603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.659250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5d0c-8cb4-403b-a607-aa213f45603f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.659693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5d0c-8cb4-403b-a607-aa213f45603f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.660140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5d0c-8cb4-403b-a607-aa213f45603f None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.662423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5d0c-8cb4-403b-a607-aa213f45603f None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.665912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5d0c-8cb4-403b-a607-aa213f45603f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.669209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 127/233] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.679169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.863714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee29606-3509-43e7-a77e-ec404cf3e25b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.934933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eda9a-db5b-4363-ab64-e3496693ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.936063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eda9a-db5b-4363-ab64-e3496693ba8b None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.936547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eda9a-db5b-4363-ab64-e3496693ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.937033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eda9a-db5b-4363-ab64-e3496693ba8b None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/c897e31d8f364522a595387b98e0c0f1/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.940935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eda9a-db5b-4363-ab64-e3496693ba8b None admin] RBAC: Authorizing `identity:create_grant(project_id=02cd5fa546554b3d9b2281d365cb1a2c, user_id=c897e31d8f364522a595387b98e0c0f1, role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.943878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eda9a-db5b-4363-ab64-e3496693ba8b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.033695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 107/234] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:55 2022] PUT /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/c897e31d8f364522a595387b98e0c0f1/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:56.844668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c7640-6edf-48c8-b3aa-5c704ade6670 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.845186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c7640-6edf-48c8-b3aa-5c704ade6670 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.845186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c7640-6edf-48c8-b3aa-5c704ade6670 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.847345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 128/235] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:56.854081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a68b-7e00-4bd9-b44a-08924e6e0105 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.854536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a68b-7e00-4bd9-b44a-08924e6e0105 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.854818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a68b-7e00-4bd9-b44a-08924e6e0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.885292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5616a68b-7e00-4bd9-b44a-08924e6e0105 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:56.886752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5616a68b-7e00-4bd9-b44a-08924e6e0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:56.941161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.024578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 108/236] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:57.321959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93483b-1eab-4ebf-b0b9-7d2aaab083e5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.322504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93483b-1eab-4ebf-b0b9-7d2aaab083e5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.322998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93483b-1eab-4ebf-b0b9-7d2aaab083e5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.326226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 129/237] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:57.333009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39472-c113-4662-81a9-0c0c4ef0950c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.333523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39472-c113-4662-81a9-0c0c4ef0950c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.333984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39472-c113-4662-81a9-0c0c4ef0950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.371771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-afd39472-c113-4662-81a9-0c0c4ef0950c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:57.373943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-afd39472-c113-4662-81a9-0c0c4ef0950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:57.470952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93483b-1eab-4ebf-b0b9-7d2aaab083e5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.519503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 109/238] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:57.525875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace2903-5fb2-4a04-ae7f-1b04d6bb2b99 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.526305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace2903-5fb2-4a04-ae7f-1b04d6bb2b99 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.526579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace2903-5fb2-4a04-ae7f-1b04d6bb2b99 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.528024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 110/239] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:57.537877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.538183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.538451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.572104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:57.573234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:57.619730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.668846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93483b-1eab-4ebf-b0b9-7d2aaab083e5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.716635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 111/240] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:57.751680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.752619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.753040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.753479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.770613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:57.776639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:57.777803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:57.778609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:57.780852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 130/241] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:57.786912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.829963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.853453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.942052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf6484-bae2-4d32-b238-4995c27f78a9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.982378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.983396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.983877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.984347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.985227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:57.985731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.987473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.997940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 112/242] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:58.003945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.047078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed363e-712a-4c9e-820d-3b5a11bd4b2f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.121258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.122343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.122632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.122908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.131820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.136857 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:58.142494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:58.143404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:58.144210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:46:58.146989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 131/243] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:58.152586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.157077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.167659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ffe8-a667-4187-b39d-0d71fb001cbd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.207065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.208072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.208551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.209044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] PATH_INFO: `/v3/users/ce415fe04a234ee7b048e98bd1fd2c60` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.226340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] RBAC: Authorizing `identity:get_user(user_id=ce415fe04a234ee7b048e98bd1fd2c60)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.228508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.230971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 113/244] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/users/ce415fe04a234ee7b048e98bd1fd2c60 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:58.236871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.282554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbfe66-8400-4657-89df-80b5dd114237 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.322839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.324099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.324597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.325088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.327142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.330018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.337952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 132/245] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:58.337952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.393937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fd9a-68a3-453f-bcdc-80f4f3816758 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.448565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.449405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.449802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.450271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.451308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:58.451772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.454245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992903-81bb-476a-8af0-b08bf20d303d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.475835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 114/246] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:58.476081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.476212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db475-f29b-444f-9239-8ae052c6a508 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.476212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db475-f29b-444f-9239-8ae052c6a508 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.476212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db475-f29b-444f-9239-8ae052c6a508 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.476212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 115/247] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:58.476212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0db475-f29b-444f-9239-8ae052c6a508 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.496574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.534885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a17453-f163-4273-ba7d-45a7e131870a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.577163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.577779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.578116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.578382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.646373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0db475-f29b-444f-9239-8ae052c6a508 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.671837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.674030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.691710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99885c59-85b2-4f0b-b433-3162490f4f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.693166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99885c59-85b2-4f0b-b433-3162490f4f30 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.693904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99885c59-85b2-4f0b-b433-3162490f4f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.695239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99885c59-85b2-4f0b-b433-3162490f4f30 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.697084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99885c59-85b2-4f0b-b433-3162490f4f30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.700087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99885c59-85b2-4f0b-b433-3162490f4f30 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.753982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.797269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 133/248] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:58.799410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.817946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 116/249] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:58 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:58.820945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.821111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.821885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.865792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:58.867945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:58.999639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.013158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0cf05-85e2-4125-a179-0cada245e266 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.014470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 117/250] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:59.021587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.083502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477a8e0-ada4-41fd-b366-3d60d65f8786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.086712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a8e0-ada4-41fd-b366-3d60d65f8786 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.087203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a8e0-ada4-41fd-b366-3d60d65f8786 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.087662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a8e0-ada4-41fd-b366-3d60d65f8786 None admin] PATH_INFO: `/v3/users/427480b88a064123a79c996a1e237092` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.089693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477a8e0-ada4-41fd-b366-3d60d65f8786 None admin] RBAC: Authorizing `identity:get_user(user_id=427480b88a064123a79c996a1e237092)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.093088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477a8e0-ada4-41fd-b366-3d60d65f8786 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.096375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 134/251] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/users/427480b88a064123a79c996a1e237092 => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:59.098744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e16b6-1118-4ff6-a386-2d940589937f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.099238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e16b6-1118-4ff6-a386-2d940589937f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.099732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e16b6-1118-4ff6-a386-2d940589937f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.102711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 135/252] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:46:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:59.107261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e16b6-1118-4ff6-a386-2d940589937f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.177500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.181794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52958dd-a426-4077-8aa8-18cae37bef61 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.222591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651854c-b3ba-4dbc-9e98-cf88a3e93316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.223550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651854c-b3ba-4dbc-9e98-cf88a3e93316 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.224053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651854c-b3ba-4dbc-9e98-cf88a3e93316 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.224521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651854c-b3ba-4dbc-9e98-cf88a3e93316 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.226130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651854c-b3ba-4dbc-9e98-cf88a3e93316 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.227856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651854c-b3ba-4dbc-9e98-cf88a3e93316 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.229885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 118/253] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:59.231388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.231880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.232347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.253074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:59.254547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:59.285622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e16b6-1118-4ff6-a386-2d940589937f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.329077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.329739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.330067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.330322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.331502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.333801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.336321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 136/254] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:59.337142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.353477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.358863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 119/255] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:59.359425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.549119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55e20-c489-4b37-b9c1-a841953eac66 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.560284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93668588-6fe7-4d22-8cca-399f04b65048 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.570632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.623269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.623953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.624233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.624503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.625248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] RBAC: Adding query filter params (role.id=7e54d4ac514741edb1b29ae85265d7ad, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=ce415fe04a234ee7b048e98bd1fd2c60) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:59.625559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.627090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.640100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 137/256] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/role_assignments?user.id=ce415fe04a234ee7b048e98bd1fd2c60&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=7e54d4ac514741edb1b29ae85265d7ad => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:59.640964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.648016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.648728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.649011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.649290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.684963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:59.692037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:59.693707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:59.695965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 120/257] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:59.702248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.821712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42bc4a-ac4a-45d4-87d4-b001c715a176 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.830314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.878540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.879665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.879947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.880227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/427480b88a064123a79c996a1e237092/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.887173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] RBAC: Authorizing `identity:create_grant(project_id=02cd5fa546554b3d9b2281d365cb1a2c, user_id=427480b88a064123a79c996a1e237092, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.888757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.894494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa72720-bdd3-45e2-8c73-16bc142f4080 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.941740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.942533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.942904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.943132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.956894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:59.962921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:59.966826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 121/258] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:59.969956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.986567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 138/259] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:59 2022] PUT /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/427480b88a064123a79c996a1e237092/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:59.987376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.086525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.204075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb8022-c2d4-49d9-800b-c4226dabc278 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.240353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.291031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82be1-dc06-484f-9069-8f1a371c94db None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.314671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.315312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.315603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.315881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.316580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:00.316887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.318372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.332642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 122/260] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.338820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.348171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.349122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.349552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.350031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.351417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:00.351874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.355765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.367264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 139/261] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.373703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.558896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbed795-c50b-45ba-a425-c1bdf2f302c5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.598578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.632370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf2e39-0fc0-4d37-b7a3-b82fc4bf8c9a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.633874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.635079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.635509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.635986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] PATH_INFO: `/v3/users/c897e31d8f364522a595387b98e0c0f1` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.639098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] RBAC: Authorizing `identity:get_user(user_id=c897e31d8f364522a595387b98e0c0f1)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.641881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.646044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 123/262] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/users/c897e31d8f364522a595387b98e0c0f1 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.651879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.738793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.739667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.739951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.740230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] PATH_INFO: `/v3/users/c897e31d8f364522a595387b98e0c0f1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.743465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] RBAC: Authorizing `identity:get_user(user_id=c897e31d8f364522a595387b98e0c0f1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.745174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.747265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 140/263] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/users/c897e31d8f364522a595387b98e0c0f1 => generated 283 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.753784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.802780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.983149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e86c74-b0ef-4f88-bc06-cc445b3b2e5e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.024326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418376f2-a5bd-43b0-a0af-0dae9ef722c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.072385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.073389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.073929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.074414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.118703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.120038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.120516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.121012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.194800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.227939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.231246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.359236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.361098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.427984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.672862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 124/264] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1022 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:47:01.680098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.770898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 141/265] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1018 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:47:01.779353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.969882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61cb18-a5c8-4d6b-8d7e-1311d582ada7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.970546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.058644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.059318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.059605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.059888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.062709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.064210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.068302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 125/266] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.074898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.087761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b77b2-7fa9-4f4e-8e41-e9b45d070b80 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.114705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.179830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.180916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.181205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.181479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.187570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.194662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.198787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 142/267] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.206586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.324277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee10f16-6e51-4436-8a34-48915f535124 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.401644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.402315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.402599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.402875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.403638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=c897e31d8f364522a595387b98e0c0f1) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:02.403949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.405440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04c0a7-8463-4e7a-a2c9-c48a914f542c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.417330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57854af5-514c-4367-8034-cc9414d638c8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.421289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 126/268] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/role_assignments?user.id=c897e31d8f364522a595387b98e0c0f1&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.423689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe329ed-b8f9-4112-8144-f9dbe9bde475 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.423996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe329ed-b8f9-4112-8144-f9dbe9bde475 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.424277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe329ed-b8f9-4112-8144-f9dbe9bde475 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.431643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 127/269] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:02.438208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.438543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.438780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.480326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:02.482610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:02.502879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.526009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.526668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.526955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.527232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.528108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] RBAC: Adding query filter params (role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=c897e31d8f364522a595387b98e0c0f1) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:02.528447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.530062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e1cb0-71fa-499e-89dc-ae19899813d1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.543446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 143/270] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/role_assignments?user.id=c897e31d8f364522a595387b98e0c0f1&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.544906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7074b2a-9fae-45b5-88be-79da8d7907f4 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.545055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7074b2a-9fae-45b5-88be-79da8d7907f4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.545331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7074b2a-9fae-45b5-88be-79da8d7907f4 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.546738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 144/271] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:02.558833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.559161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.559397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.617128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:02.619527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:02.667388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 128/272] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:02.744614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 145/273] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:03.058369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.062788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.067915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.198785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09c957-4215-4b2b-a717-ef30a663a994 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.219888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.226374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c263226-e644-4651-af57-a3ad6f751353 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.241908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea524a3c-2597-4387-9045-494896e81bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.242467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea524a3c-2597-4387-9045-494896e81bcb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.242747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea524a3c-2597-4387-9045-494896e81bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.243018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea524a3c-2597-4387-9045-494896e81bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.255702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea524a3c-2597-4387-9045-494896e81bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ea524a3c-2597-4387-9045-494896e81bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:03.261761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:03.263212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:03.264794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:03.273425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 146/274] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:03.273425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0b1f-622c-443a-b9ba-eed2b2303545 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.273425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0b1f-622c-443a-b9ba-eed2b2303545 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.273425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0b1f-622c-443a-b9ba-eed2b2303545 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.273425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 147/275] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:03.277237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa0b1f-622c-443a-b9ba-eed2b2303545 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.280625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5bf07-660c-4cd3-b450-d97fe1134403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.281883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5bf07-660c-4cd3-b450-d97fe1134403 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.282349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5bf07-660c-4cd3-b450-d97fe1134403 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.282815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5bf07-660c-4cd3-b450-d97fe1134403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.284684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5bf07-660c-4cd3-b450-d97fe1134403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.287249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5bf07-660c-4cd3-b450-d97fe1134403 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.290377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 129/276] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.294878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.294878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.294878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.324737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:03.326819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:03.438706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 130/277] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:03.446129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa0b1f-622c-443a-b9ba-eed2b2303545 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.447772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.471255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.523250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.524892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.525548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.526268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.527588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.528702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.531586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.548599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 148/278] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:03.555660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.639965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.674957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a61d9a-e120-4a29-ae43-41cd7559ef91 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.744318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.745246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.745360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed61cf-86c6-4d16-8633-cf0f02a7de27 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.745678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.746150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.747229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.749540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.791930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.792657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.792941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.793212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] PATH_INFO: `/v3/users/03177be9f11c4367b8d57055e3dc642e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.811182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] RBAC: Authorizing `identity:get_user(user_id=03177be9f11c4367b8d57055e3dc642e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.813041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.814910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 149/279] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/users/03177be9f11c4367b8d57055e3dc642e => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:03.822311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.872457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 131/280] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:03 2022] POST /identity/v3/users => generated 293 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:03.873562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.976390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.979154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.982926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d2ced-129e-467a-8c48-445836c6047e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.026408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7408e-6373-4712-aec5-194020d51beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.027912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7408e-6373-4712-aec5-194020d51beb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.027912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7408e-6373-4712-aec5-194020d51beb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.033370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7408e-6373-4712-aec5-194020d51beb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.037385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20af3-acfd-416a-9675-7fe0a3474dac None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.055478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7408e-6373-4712-aec5-194020d51beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1bd7408e-6373-4712-aec5-194020d51beb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:04.065889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:04.074645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 150/281] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:04.076313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e498-dc84-4de7-8372-4c7a2c99d32d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.077873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e498-dc84-4de7-8372-4c7a2c99d32d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.077873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e498-dc84-4de7-8372-4c7a2c99d32d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.080652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 151/282] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:04.082239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e498-dc84-4de7-8372-4c7a2c99d32d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.126579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.127570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.128018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.128408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.129645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, user.id=03177be9f11c4367b8d57055e3dc642e, scope.system=all) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:04.130222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.133033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e50ea-ced4-42cc-a6d3-f0d63f918d69 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.141471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 132/283] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/role_assignments?user.id=03177be9f11c4367b8d57055e3dc642e&scope.system=all&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:04.143311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943fed-1253-48e3-a356-e177002de38f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.143784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943fed-1253-48e3-a356-e177002de38f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.144245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87943fed-1253-48e3-a356-e177002de38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.184642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-87943fed-1253-48e3-a356-e177002de38f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:04.186679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-87943fed-1253-48e3-a356-e177002de38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:04.279117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 133/284] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:04.307103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e498-dc84-4de7-8372-4c7a2c99d32d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.358486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.359778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.360425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.361090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.362447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:04.363162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.366443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.387580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 152/285] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:04.395563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943fed-1253-48e3-a356-e177002de38f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.525125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.625025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87943fed-1253-48e3-a356-e177002de38f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.705993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.707639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.707639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.708058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] PATH_INFO: `/v3/users/ce415fe04a234ee7b048e98bd1fd2c60` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.710301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] RBAC: Authorizing `identity:get_user(user_id=ce415fe04a234ee7b048e98bd1fd2c60)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.713120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.716612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 134/286] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/users/ce415fe04a234ee7b048e98bd1fd2c60 => generated 297 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:04.724588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.773691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.981236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88916a-c1c5-4b78-b9db-032bc73a027f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.066001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.067064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.067563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.068052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.070239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.073036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.076474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 153/287] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.085098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.095918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.371594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305e076-87c0-47f2-8456-1e6e89235350 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.382786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.420701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.435667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65c2d8-a849-4462-8c3d-95ae382b95fd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.438590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.440750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.441198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.441481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/ce415fe04a234ee7b048e98bd1fd2c60/roles/7e54d4ac514741edb1b29ae85265d7ad` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.444745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cd5fa546554b3d9b2281d365cb1a2c, user_id=ce415fe04a234ee7b048e98bd1fd2c60, role_id=7e54d4ac514741edb1b29ae85265d7ad)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.447649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.503557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.504801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.505273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.505723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.538174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 135/288] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:05 2022] PUT /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/users/ce415fe04a234ee7b048e98bd1fd2c60/roles/7e54d4ac514741edb1b29ae85265d7ad => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:05.539891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:05.549194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:05.550198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:05.550993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:05.552241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 154/289] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:05.561806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.791316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bddb7-57d6-4586-881a-8e7e8bb7e485 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.855718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.856763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.857262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.857751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.859010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.859537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.862293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.880016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 136/290] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.890121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.098711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcb2af-47ca-430f-b766-ebc0021145f1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.169480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.170577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.171048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.171502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] PATH_INFO: `/v3/users/427480b88a064123a79c996a1e237092` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.173791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] RBAC: Authorizing `identity:get_user(user_id=427480b88a064123a79c996a1e237092)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.177027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.180949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 155/291] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/users/427480b88a064123a79c996a1e237092 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:06.187141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.283902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.399062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacddba8-6c17-456d-8db8-da68c7b9ab0c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.474522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27814cf4-0255-4e55-b945-a1eb6d6974a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.475704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27814cf4-0255-4e55-b945-a1eb6d6974a8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.476160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27814cf4-0255-4e55-b945-a1eb6d6974a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.476607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27814cf4-0255-4e55-b945-a1eb6d6974a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.617550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27814cf4-0255-4e55-b945-a1eb6d6974a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.620039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27814cf4-0255-4e55-b945-a1eb6d6974a8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.715110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.858536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 137/292] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:06.864774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.917524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.931897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747605-c149-4c7a-ad72-0a38c1089c34 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.932403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747605-c149-4c7a-ad72-0a38c1089c34 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.932882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a747605-c149-4c7a-ad72-0a38c1089c34 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.935697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 138/293] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:06.942810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22da2a-bf0c-4369-8de6-60b60cf39950 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.943361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22da2a-bf0c-4369-8de6-60b60cf39950 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.943844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22da2a-bf0c-4369-8de6-60b60cf39950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.995041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4e22da2a-bf0c-4369-8de6-60b60cf39950 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:06.997083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4e22da2a-bf0c-4369-8de6-60b60cf39950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:07.100590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff704c7-53ab-4fed-80a4-44cfc18ccc51 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.176327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.178063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.178812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.179499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.182564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.186558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.191628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 156/294] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:07.199817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.226072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 139/295] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:07.323507 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.350270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8f415-b115-4e34-8d41-4fb318f57d91 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.407055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.407666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.407945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.408205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.408932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=427480b88a064123a79c996a1e237092) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:07.409236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.410711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4eab61-fbb1-4cfe-99b3-8fcfbaf5d8e6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.417731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 157/296] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/role_assignments?user.id=427480b88a064123a79c996a1e237092&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:07.515430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2694dc-c4f8-48d6-b9cb-9546b41f3280 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.515932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2694dc-c4f8-48d6-b9cb-9546b41f3280 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.516035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2694dc-c4f8-48d6-b9cb-9546b41f3280 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.517717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 140/297] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:07.523484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.523764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.524045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.547787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:07.549193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:07.630518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2694dc-c4f8-48d6-b9cb-9546b41f3280 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.653994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 158/298] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:07.725392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.753291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2694dc-c4f8-48d6-b9cb-9546b41f3280 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.807944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.808614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.808895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.809170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.826070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:07.838094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:07.839026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:07.840264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 141/299] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:07.845961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.994112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.026355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ceae-2533-4ca7-83ca-a88cd6966eda None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.036013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.099592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.100756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.101039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.101313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.102038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:08.102347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.103839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.123452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 159/300] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:08.135145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.206787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3b9c-ccca-49eb-8966-7b7d9fccec2b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.250264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c7288-cc2a-46a0-8e4f-053e16804d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.250833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c7288-cc2a-46a0-8e4f-053e16804d87 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.251116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c7288-cc2a-46a0-8e4f-053e16804d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.251390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c7288-cc2a-46a0-8e4f-053e16804d87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.252585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c7288-cc2a-46a0-8e4f-053e16804d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.254375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c7288-cc2a-46a0-8e4f-053e16804d87 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.256555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 142/301] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:08.257748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5a12-d258-4fd7-b019-0edbe77597ce None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.258077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5a12-d258-4fd7-b019-0edbe77597ce None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.258327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5a12-d258-4fd7-b019-0edbe77597ce None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.259708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 143/302] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:08.265780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.266198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.266344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.273598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.288753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:08.293599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:08.346673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e142-4ebd-489a-b101-a297caedc3fb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.376022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 144/303] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:08.379789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.429408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.430553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.431065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.431568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] PATH_INFO: `/v3/users/a6d301cb4c5348f993f1e4df9d7cc317` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.455677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.463732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d301cb4c5348f993f1e4df9d7cc317)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.470031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.471240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 160/304] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/users/a6d301cb4c5348f993f1e4df9d7cc317 => generated 293 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:08.481809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.600872 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda0a02-4278-4d54-80e7-320bc2cfa56a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.658380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.664361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671be65-6505-4030-bf67-4580f8699560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.665012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671be65-6505-4030-bf67-4580f8699560 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.665314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671be65-6505-4030-bf67-4580f8699560 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.665600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671be65-6505-4030-bf67-4580f8699560 None admin] PATH_INFO: `/v3/groups` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.666315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671be65-6505-4030-bf67-4580f8699560 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.682267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671be65-6505-4030-bf67-4580f8699560 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.682458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d0816-af76-46de-b7e2-b2c381c3bdb0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.720375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.720992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.721271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.721543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.722315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] RBAC: Adding query filter params (role.id=7e54d4ac514741edb1b29ae85265d7ad, user.id=a6d301cb4c5348f993f1e4df9d7cc317, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:08.722624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.724086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3961c06-2f16-4ebf-8f94-63588b38827d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.730152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 161/305] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/role_assignments?user.id=a6d301cb4c5348f993f1e4df9d7cc317&scope.system=all&role.id=7e54d4ac514741edb1b29ae85265d7ad => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:08.731490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44f3e-fb31-465b-aef1-6207f2fcb5d2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.731774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44f3e-fb31-465b-aef1-6207f2fcb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.732047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a44f3e-fb31-465b-aef1-6207f2fcb5d2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.733380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 162/306] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:08.734157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44f3e-fb31-465b-aef1-6207f2fcb5d2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.780109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 145/307] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Oct 10 11:47:08 2022] POST /identity/v3/groups => generated 229 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:08.782410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.782983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.783450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.829610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:08.832666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:08.856899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.934905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a44f3e-fb31-465b-aef1-6207f2fcb5d2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.975421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 146/308] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:09.009030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.009766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.010084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.010358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.023162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:09.028386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:09.030165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:09.031827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 163/309] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:09.039862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.208903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556f48-8d3f-4199-8f40-604e4206be34 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.254752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.275550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.276622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.277118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.277611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.278929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.279459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.282161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.300168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 147/310] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:09.305982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.455916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7968dd-1dad-4bd5-9a20-57e1d0e63e68 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.499248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.517887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.523961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.524964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.525425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.525902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] PATH_INFO: `/v3/users/03177be9f11c4367b8d57055e3dc642e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.527896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] RBAC: Authorizing `identity:get_user(user_id=03177be9f11c4367b8d57055e3dc642e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.530441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.533754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 164/311] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/users/03177be9f11c4367b8d57055e3dc642e => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.540185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.661226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86de20-8eb4-4443-9718-9cd278480995 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.704160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0d151-2278-479d-9d9c-3327863a9291 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.708443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.714021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.714021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.714021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.724171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:09.731886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:09.733096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:09.734102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:09.740999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 148/312] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:09.742912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.760752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.762543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.763190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.763750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] PATH_INFO: `/v3/system/users/03177be9f11c4367b8d57055e3dc642e/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.766655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=03177be9f11c4367b8d57055e3dc642e, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.768429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.802788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.862717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 165/313] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Oct 10 11:47:09 2022] PUT /identity/v3/system/users/03177be9f11c4367b8d57055e3dc642e/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:09.881713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f878-7151-4b64-95b2-c37e21b6fc4a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.929353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.930255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.930805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.931230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.932077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.932495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.934215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.946712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 149/314] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.953353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.039842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.122719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc0e8-77f4-41cb-922b-4a3cfb76b90b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:10.187396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:10.188060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:10.188350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:10.188614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] PATH_INFO: `/v3/users/ce415fe04a234ee7b048e98bd1fd2c60` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:10.190846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] RBAC: Authorizing `identity:get_user(user_id=ce415fe04a234ee7b048e98bd1fd2c60)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:10.194564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:10.198655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 166/315] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/users/ce415fe04a234ee7b048e98bd1fd2c60 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:10.208084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.353215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedda64-157e-4ad6-95aa-9a4c873bee37 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:10.361223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.399320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:10.400770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:10.401547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:10.402403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:10.513084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:10.514979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:10.627993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 150/316] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:10.636391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.853501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dace5-383b-4bbf-8d0a-ad0c1481cddb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:10.899240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.921343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deabe6e-d369-4f1d-b938-ba3d4aac9e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:10.922428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deabe6e-d369-4f1d-b938-ba3d4aac9e74 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:10.922887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deabe6e-d369-4f1d-b938-ba3d4aac9e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:10.923332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deabe6e-d369-4f1d-b938-ba3d4aac9e74 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:10.925276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deabe6e-d369-4f1d-b938-ba3d4aac9e74 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:10.928197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deabe6e-d369-4f1d-b938-ba3d4aac9e74 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:10.936409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 167/317] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:10 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:10.944466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.958869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:11.065813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d6b7-17db-4278-b650-f9f6004b56b4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:11.108321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:11.109311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.109808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.110328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.111324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] RBAC: Adding query filter params (role.id=7e54d4ac514741edb1b29ae85265d7ad, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c, user.id=ce415fe04a234ee7b048e98bd1fd2c60) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:11.111840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:11.113625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57541149-d52a-4a71-9582-3268e0954cae None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:11.121460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 151/318] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:10 2022] GET /identity/v3/role_assignments?user.id=ce415fe04a234ee7b048e98bd1fd2c60&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=7e54d4ac514741edb1b29ae85265d7ad => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:11.293659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ec74-ec88-4b4d-934f-8ec27b832b36 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.294405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ec74-ec88-4b4d-934f-8ec27b832b36 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.294405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ec74-ec88-4b4d-934f-8ec27b832b36 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.295881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 168/319] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:11.302026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9948a-2387-4af7-8838-155546514279 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.302449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9948a-2387-4af7-8838-155546514279 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.302732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9948a-2387-4af7-8838-155546514279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.323598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b3d9948a-2387-4af7-8838-155546514279 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:11.324900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b3d9948a-2387-4af7-8838-155546514279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:11.432418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:11.442094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 152/320] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:11.942782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ec74-ec88-4b4d-934f-8ec27b832b36 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:11.964943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91bdd0-28c5-4168-852b-35767b9f4fd8 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.965458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91bdd0-28c5-4168-852b-35767b9f4fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.965531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91bdd0-28c5-4168-852b-35767b9f4fd8 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.967885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 153/321] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:11.973179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.973474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.973757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.995683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:11.998251 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:12.094800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 154/322] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:12.131740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ec74-ec88-4b4d-934f-8ec27b832b36 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.192158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf4e2-2c2a-4e79-9c50-0e441a52b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.193660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf4e2-2c2a-4e79-9c50-0e441a52b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.194418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf4e2-2c2a-4e79-9c50-0e441a52b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.195124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf4e2-2c2a-4e79-9c50-0e441a52b8e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.197312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adf4e2-2c2a-4e79-9c50-0e441a52b8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:12.200072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adf4e2-2c2a-4e79-9c50-0e441a52b8e3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:12.203644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 169/323] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:12.210159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.329077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a1c80-cdcc-43be-b802-9e07d0431ed8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.366904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:12.374691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.375364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.375646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.375943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] PATH_INFO: `/v3/groups` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.376617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:12.378231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:12.483118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 155/324] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Oct 10 11:47:12 2022] POST /identity/v3/groups => generated 226 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:12.490129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989040bb-434f-4a35-b954-e79ccd6d6c59 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.490129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989040bb-434f-4a35-b954-e79ccd6d6c59 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.490129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989040bb-434f-4a35-b954-e79ccd6d6c59 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.490129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 170/325] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:12.491374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.491666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.491947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.513665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:12.514983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:12.588304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:12.598865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.613998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 171/326] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:12.724372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc48ae7-a51a-48a0-876a-8ebb49a0c8ab None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.774739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.775806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.776259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.776779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.797008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:12.808150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:12.809105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:12.809912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:12.811001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 156/327] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:12.817117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.979336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.982401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed379cd-19a3-4af2-93db-fe764835bfc8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.044952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.045579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.045932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.046180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.046927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:13.047236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.048716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.060313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 172/328] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:13.066342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.069377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.143662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.150886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f320d9-8461-4847-8c5e-d61e3943ba97 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.205334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.206304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.207158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.207442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.226441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:13.232639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:13.234373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:13.235969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:13.241889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 157/329] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:13.241889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.255191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41edf41-f1e6-4bbc-b1af-4fdb60e59a97 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.335280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.336340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.336973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.337449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] PATH_INFO: `/v3/users/a6d301cb4c5348f993f1e4df9d7cc317` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.339622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] RBAC: Authorizing `identity:get_user(user_id=a6d301cb4c5348f993f1e4df9d7cc317)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.342318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.350444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 173/330] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/users/a6d301cb4c5348f993f1e4df9d7cc317 => generated 293 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:13.359566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.409734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f118-f4e3-443c-a893-20c5221a5a96 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.427680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.479063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.480152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.480652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.481473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.482463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:13.483040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.484891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.504484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 158/331] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:13.507552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.557661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bfe4e-9021-45ee-890f-5847856691ad None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.579225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.605271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.606164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.606474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.606753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] PATH_INFO: `/v3/system/users/a6d301cb4c5348f993f1e4df9d7cc317/roles/7e54d4ac514741edb1b29ae85265d7ad` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.608303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6d301cb4c5348f993f1e4df9d7cc317, role_id=7e54d4ac514741edb1b29ae85265d7ad)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.610408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.688013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 174/332] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Oct 10 11:47:13 2022] PUT /identity/v3/system/users/a6d301cb4c5348f993f1e4df9d7cc317/roles/7e54d4ac514741edb1b29ae85265d7ad => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:13.734397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f7dd7-9844-4b19-978f-30e92591dd36 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.811624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb2335-cf8f-4c98-9449-05c7b6a163b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.813301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2335-cf8f-4c98-9449-05c7b6a163b4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.814152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2335-cf8f-4c98-9449-05c7b6a163b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.815149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2335-cf8f-4c98-9449-05c7b6a163b4 None admin] PATH_INFO: `/v3/users/03177be9f11c4367b8d57055e3dc642e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.817906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb2335-cf8f-4c98-9449-05c7b6a163b4 None admin] RBAC: Authorizing `identity:get_user(user_id=03177be9f11c4367b8d57055e3dc642e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.821232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb2335-cf8f-4c98-9449-05c7b6a163b4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.825311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 159/333] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/users/03177be9f11c4367b8d57055e3dc642e => generated 293 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:13.831349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.046805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27fc29-27ff-4abf-b4af-747b23c571b7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.112335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.113824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.114668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.115744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.117406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] RBAC: Adding query filter params (role.id=7acb4f2b69ec4c21a3c969d994c72845, user.id=03177be9f11c4367b8d57055e3dc642e, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:14.118252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.121375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd20a73-0b1f-48dd-b0c8-87fc29d24394 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.148419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 175/334] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/role_assignments?user.id=03177be9f11c4367b8d57055e3dc642e&scope.system=all&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 510 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:15.649549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbda6d-1957-40a0-9bcb-4c12ad2e27bc None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.650529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbda6d-1957-40a0-9bcb-4c12ad2e27bc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.651040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbda6d-1957-40a0-9bcb-4c12ad2e27bc None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.652861 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 160/335] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:15.659046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fb55e-900d-4da2-ba34-bbdee95724b3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.659950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fb55e-900d-4da2-ba34-bbdee95724b3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.660425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fb55e-900d-4da2-ba34-bbdee95724b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.687584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-161fb55e-900d-4da2-ba34-bbdee95724b3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:15.689146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-161fb55e-900d-4da2-ba34-bbdee95724b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:15.738808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.782256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 176/336] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:15.990615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02f628-8c92-4e3f-890e-d77bc603166e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.991222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02f628-8c92-4e3f-890e-d77bc603166e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.991724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02f628-8c92-4e3f-890e-d77bc603166e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.993305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 161/337] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:15.999276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.999868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.000339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.020223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:16.026387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:16.122907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 177/338] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:16.284027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02f628-8c92-4e3f-890e-d77bc603166e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.345057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:16.427051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02f628-8c92-4e3f-890e-d77bc603166e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:16.518162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:16.519278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.519826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.520322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.545476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:16.555342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:16.556300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:16.557080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:16.558194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 162/339] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:16.564301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.699163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:16.706353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df69fb7-d8af-4344-bcd6-4e2461ad7a19 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:16.754416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:16.755065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.755338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.755614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.756355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:16.756654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:16.758080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:16.775114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 178/340] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:16.781900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.855086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.987257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3131fa4-0326-4268-89d7-43aaadc4aea4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.038735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.039402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.039683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.039966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.047730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.058767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947764-f853-4867-bdf2-46d2726f93ce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.066991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:17.073171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:17.075257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:17.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:17.080777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 179/341] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:17.089171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.121540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.122678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.122955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.123232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.158557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.242017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.243515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.275273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0dbc4-defc-4bc1-8d60-7cd6355ff337 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.334160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.334900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.335186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.335463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.336146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:17.336449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.338071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.352053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 180/342] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:17.362505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.385178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.393961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 163/343] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:17.399699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.521769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.543104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534719e6-d3a8-4fdf-8804-096f5b51f581 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.550256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff45dbd-1e5e-4537-919f-eb743f84128a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.587661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6390c9-db9c-4294-8b30-9128592e6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.588351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6390c9-db9c-4294-8b30-9128592e6fdf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.588636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6390c9-db9c-4294-8b30-9128592e6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.588918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6390c9-db9c-4294-8b30-9128592e6fdf None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.590410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6390c9-db9c-4294-8b30-9128592e6fdf None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.592348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6390c9-db9c-4294-8b30-9128592e6fdf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.594810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 164/344] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:17.596716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678c75-133d-435a-9746-f21752d1b63b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.597161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678c75-133d-435a-9746-f21752d1b63b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.597449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678c75-133d-435a-9746-f21752d1b63b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.603653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 165/345] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:17.606202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678c75-133d-435a-9746-f21752d1b63b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.644803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.645336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.645623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.645930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.700646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.734255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678c75-133d-435a-9746-f21752d1b63b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.777781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0c06-d452-44fe-8290-25dae0904ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.778486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0c06-d452-44fe-8290-25dae0904ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.778768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0c06-d452-44fe-8290-25dae0904ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.779044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0c06-d452-44fe-8290-25dae0904ce9 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.786286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0c06-d452-44fe-8290-25dae0904ce9 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.788412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0c06-d452-44fe-8290-25dae0904ce9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.790567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 166/346] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:17.791878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.792164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.792439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.817897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:17.819148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:17.830016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.833826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.046644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 167/347] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:18.050795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.210664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.253080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 181/348] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 891 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:47:18.285284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.295709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.429748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a6f89-51d8-4779-a4b1-66b823b54be7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.520925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0a7b-7d66-4417-b599-00cabe24807f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.576094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.577182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.577734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.578237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.579686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=a3e0239b8ed2442892410300591841f2) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:18.580311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.583012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b778-67c2-4a97-ab3e-5d7e70c2b25d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.596734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 168/349] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 260 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.599408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.600720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.601230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.601329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8bdc9-c836-4c6b-ad99-1cb03bc8921e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.601712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8bdc9-c836-4c6b-ad99-1cb03bc8921e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.601806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.602256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8bdc9-c836-4c6b-ad99-1cb03bc8921e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.604220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.606987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.610586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 169/350] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:18.610764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 182/351] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.612196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8bdc9-c836-4c6b-ad99-1cb03bc8921e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.620059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.794508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.898201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282550c8-cdf5-4af6-8006-9016e0bff7ce None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.926632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8bdc9-c836-4c6b-ad99-1cb03bc8921e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.944101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50483b7-1e4d-44d2-aba2-ac3f83166a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.945141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50483b7-1e4d-44d2-aba2-ac3f83166a2a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.945629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50483b7-1e4d-44d2-aba2-ac3f83166a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.946172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50483b7-1e4d-44d2-aba2-ac3f83166a2a None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.947621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50483b7-1e4d-44d2-aba2-ac3f83166a2a None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.950034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50483b7-1e4d-44d2-aba2-ac3f83166a2a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.951987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 183/352] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.953440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.954645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.955135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.976005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:18.977734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:18.980487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.020749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.022729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.026577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.027149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.066343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 184/353] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:19.067660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.068795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:19.090420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.091380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:19.092205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 170/354] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:19.105178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.173881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.269150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781e79-4510-433c-bc80-e484baab9b9b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.351119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.351709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.351990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.352266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.353012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=a3e0239b8ed2442892410300591841f2) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:19.353323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.354825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472d63-15b6-4e62-84a2-2e1a0338415d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.365607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 185/355] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 260 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:19.368297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cce3a-7e66-40f5-bf22-a9508a8d3885 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.368573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cce3a-7e66-40f5-bf22-a9508a8d3885 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.368852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cce3a-7e66-40f5-bf22-a9508a8d3885 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.370349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 186/356] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:19.380014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.380318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.380568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.390965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda080-849a-45d6-b9bb-82a8da27e82d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.423851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:19.425110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:19.478823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.480190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.480478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.480750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.481446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:19.481987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.483545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.525631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 171/357] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:19.528090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.621082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 187/358] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:19.622588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.710936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.750411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.869000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc20f-e550-4659-9eec-ebbb75859c39 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.904659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de3d22-76c0-402b-9f2c-32d340d3594e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.949531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.950203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.950494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.950768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.979270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:19.988385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.989327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:19.990900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 172/359] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:19.997531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.998187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.998492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.998729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.005547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.196139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.197736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.274708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.283351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e18d-0b7c-45e8-b07a-a3d8a1579b61 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.305763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.348505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.349258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.350142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.350577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.351355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.351697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.353391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8cfa-6fa6-4d07-9f09-fd9c136aeebd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.366034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 173/360] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.367381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3cdc8-9b03-4843-9db7-70fcde66d417 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.367904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3cdc8-9b03-4843-9db7-70fcde66d417 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.368199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3cdc8-9b03-4843-9db7-70fcde66d417 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.369648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 174/361] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:20.370579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3cdc8-9b03-4843-9db7-70fcde66d417 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.372671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 188/362] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:20.377801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.511678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3cdc8-9b03-4843-9db7-70fcde66d417 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.528874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9c4b8-26f3-4886-86e8-513d06fcbfbf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.552348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353da55-3e2f-4925-9ee6-07d7bb2dfb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.553541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353da55-3e2f-4925-9ee6-07d7bb2dfb11 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.553877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353da55-3e2f-4925-9ee6-07d7bb2dfb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.554166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353da55-3e2f-4925-9ee6-07d7bb2dfb11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.570079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353da55-3e2f-4925-9ee6-07d7bb2dfb11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f353da55-3e2f-4925-9ee6-07d7bb2dfb11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:20.575904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:20.577729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:20.579376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 175/363] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:20.583096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af167-1679-48e7-9664-f8621410a15c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.583397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af167-1679-48e7-9664-f8621410a15c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.583676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af167-1679-48e7-9664-f8621410a15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.605372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f19af167-1679-48e7-9664-f8621410a15c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:20.606620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f19af167-1679-48e7-9664-f8621410a15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:20.618357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.620062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.620930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.621690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] PATH_INFO: `/v3/users/a6d301cb4c5348f993f1e4df9d7cc317` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.624439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d301cb4c5348f993f1e4df9d7cc317)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.627989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.632333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 189/364] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/users/a6d301cb4c5348f993f1e4df9d7cc317 => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.634398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.639459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.673639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.689567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 176/365] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:20.690361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af167-1679-48e7-9664-f8621410a15c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.808777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af167-1679-48e7-9664-f8621410a15c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.821815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d8068-1150-4e96-b1a8-7abc0d40bbe1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.855303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.856075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.856321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.856552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.857232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.857531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.859232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.877880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 177/366] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.877880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.906194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.907658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.908150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.908449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.908885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.913267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.915275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.917718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 190/367] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.923187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.002208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146200ba-406d-493b-b8f5-010e49b7c9e0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.043625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.044256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.044539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.044813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.045559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] RBAC: Adding query filter params (role.id=7e54d4ac514741edb1b29ae85265d7ad, user.id=a6d301cb4c5348f993f1e4df9d7cc317, scope.system=all) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:21.045888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.047402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.063092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 178/368] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/role_assignments?user.id=a6d301cb4c5348f993f1e4df9d7cc317&scope.system=all&role.id=7e54d4ac514741edb1b29ae85265d7ad => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:21.063887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.115946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.163825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe185-7f86-4241-b38f-ff319eec07ec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.168310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.190684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71c1a-d822-4c48-87fe-8a0b4b8114a5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.242911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.243584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.243870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.244238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.246508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.247662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.248224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.248726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.250899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.253871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.255996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 179/369] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:21.261975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.418874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.421645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.462967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fde80-cf8c-48b6-bdbb-266014c9a43d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.534744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.535538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.535818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.536098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.538474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:21.538786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.540276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.548039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 180/370] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:21.549313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.600295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.637327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.681446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 191/371] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:21.687839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.753929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcf24a-c31a-41d6-82f9-89da98fdf63d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.828366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.829016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.829295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.830838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.852975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:21.858372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:21.859289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:21.860069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:21.861685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 181/372] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:21.867987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.902108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a150d-f5d3-4d8d-b3f9-deacfb76400e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.965879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.966655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.966812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.967047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.969106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.970586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.972587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 192/373] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:21.979693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.027926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.078226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a31ebf-29d6-4d9c-a0d8-4c40fe05318d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.084818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.155441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.156068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.156354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.156630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.157305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.157610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.159364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.178845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 182/374] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.182249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.190172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82485d-49fd-4257-b21b-1d5795cda69c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.268237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.268881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.271201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.271520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.272861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.274378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.278399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 193/375] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.282345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.399837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a30e7-dc33-40ac-8a16-3aa4d152426a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.454395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc5e81-2020-40b0-8c76-153ea9cd26c8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.461143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cad61-f557-4443-b877-661fb5d6f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.461143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cad61-f557-4443-b877-661fb5d6f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.461143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cad61-f557-4443-b877-661fb5d6f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.461143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cad61-f557-4443-b877-661fb5d6f9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.467974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.496581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.538470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.539782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.540023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.540458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.543844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.544104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.546551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.564931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 194/376] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.607573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cad61-f557-4443-b877-661fb5d6f9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.609636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cad61-f557-4443-b877-661fb5d6f9a9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.795780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 183/377] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:47:22.803697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.824456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ee33-de18-4e34-8847-0721b586a3f3 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.825131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ee33-de18-4e34-8847-0721b586a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.826341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ee33-de18-4e34-8847-0721b586a3f3 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.828045 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 184/378] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:22.902253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525198ad-08c1-48f7-acd6-2ae185d75124 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.903194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525198ad-08c1-48f7-acd6-2ae185d75124 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.904076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525198ad-08c1-48f7-acd6-2ae185d75124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.941893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-525198ad-08c1-48f7-acd6-2ae185d75124 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:22.946487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-525198ad-08c1-48f7-acd6-2ae185d75124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:22.997992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f96cb-6444-4751-819c-712d05b43b00 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.007325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:23.063721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2846aad-5b0e-40ed-bb70-d64edc5495eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.064946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846aad-5b0e-40ed-bb70-d64edc5495eb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.065913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846aad-5b0e-40ed-bb70-d64edc5495eb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.066401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2846aad-5b0e-40ed-bb70-d64edc5495eb None admin] PATH_INFO: `/v3/projects/8cf9335e1dea43c7bd781d2850348eb6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.068771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2846aad-5b0e-40ed-bb70-d64edc5495eb None admin] RBAC: Authorizing `identity:get_project(project_id=8cf9335e1dea43c7bd781d2850348eb6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:23.070538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2846aad-5b0e-40ed-bb70-d64edc5495eb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:23.072859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 195/379] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/projects/8cf9335e1dea43c7bd781d2850348eb6 => generated 344 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:23.076020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71c7aa-25b4-4ad3-811c-81a614c524e6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.076609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71c7aa-25b4-4ad3-811c-81a614c524e6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.077098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71c7aa-25b4-4ad3-811c-81a614c524e6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.079352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 196/380] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:23.080316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71c7aa-25b4-4ad3-811c-81a614c524e6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.082321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 185/381] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:23.088757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.088757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.088757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.118695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:23.121247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:23.218341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:23.310086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71c7aa-25b4-4ad3-811c-81a614c524e6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.331373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 186/382] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:23.375252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.376341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.376832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.377198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] PATH_INFO: `/v3/groups/2a10d92ae7184c59963d55ea3cff0d39` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.387517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] RBAC: Authorizing `identity:get_group(group_id=2a10d92ae7184c59963d55ea3cff0d39)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:23.390370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:23.393472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 197/383] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:23 2022] GET /identity/v3/groups/2a10d92ae7184c59963d55ea3cff0d39 => generated 229 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:23.401311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.537981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.652505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:23.671729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00202f-c106-4560-8cde-a1a6e9eac7fc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.702758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48246-e6b5-4681-8c64-12e20b8a5d3b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.733988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:23.765332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.766002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.766288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.766567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.767314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] RBAC: Adding query filter params (group.id=2a10d92ae7184c59963d55ea3cff0d39, role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=8cf9335e1dea43c7bd781d2850348eb6) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:23.767633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:23.769093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:23.775337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.775996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.776277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.776550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.786195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 187/384] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:23 2022] GET /identity/v3/role_assignments?group.id=2a10d92ae7184c59963d55ea3cff0d39&scope.project.id=8cf9335e1dea43c7bd781d2850348eb6&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 260 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:23.793838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:23.799516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:23.800477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:23.801717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 198/385] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:23.807656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.934950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a5ae5-e08d-4c23-a747-6acd380663a9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.981040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.981665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.982091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.982284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.982965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:23.983272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:23.984663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:23.995075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 188/386] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:24.001501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.002060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.045176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.156196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bfb41-764c-40b9-a21a-5347d46bdc61 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.182116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569600c-d0ec-439a-90d8-b746f0418f35 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.201308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.202031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.202307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.202578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.205063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.206654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.209725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 199/387] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:24.216301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.260030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.260705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.260990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.261260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.286612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.295452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:24.302058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:24.303947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:24.304780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:24.306044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 189/388] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:24.324509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.365600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bef4cf-81da-4c71-aab2-268a2a4f149e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.406845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.407491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.407769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.408041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.413880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.413880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.415339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 200/389] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:24.422066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.482998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.504627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df34f-0e11-457b-ab89-80f6e6fbee34 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.548794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.549435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.549722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.550035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.550745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:24.551053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.553058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c1205-9d77-4657-bcd0-dbbf5b264cb4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.563629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 190/390] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:24.565022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17487c93-96d7-4ac2-bc54-c441dbac143a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.565316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17487c93-96d7-4ac2-bc54-c441dbac143a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.565593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17487c93-96d7-4ac2-bc54-c441dbac143a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.567276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 191/391] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:24.575237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.575795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.576230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.600732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:24.602432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:24.635224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44581561-9184-41e1-9c3c-80692630e9db None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.648318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.688020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.689516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.690243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.690945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.695398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e0239b8ed2442892410300591841f2, group_id=2cac7ab3bfc3402ca8fe5170afd3ce37, role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.697764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.722256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 192/392] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:24.726390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.820730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 201/393] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Oct 10 11:47:24 2022] PUT /identity/v3/projects/a3e0239b8ed2442892410300591841f2/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:24.870353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.909287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0d947-feea-4e97-b63d-ac6bcae40147 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.963598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.964257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.964540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.964814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.966147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.967691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.969747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 193/394] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:24.976651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.094073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.216392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d790-c4a6-4f71-9f5a-8b67bf3731cd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.272353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82a0b9-9767-44af-9b10-2c6ce12b3c3f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.304401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.306066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.307086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.307865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.311295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.315133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.317730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.318966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.319247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.319527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.321734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 202/395] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:25.328138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.336870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.340978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:25.347134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:25.355518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:25.357110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 194/396] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:25.360941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.415229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.491220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073193-124e-4b85-b808-2feb36fe0bf6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.534080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.534688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.534970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.535248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.538235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e0239b8ed2442892410300591841f2, group_id=2cac7ab3bfc3402ca8fe5170afd3ce37, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.540274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.593003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646e0f1-1abf-4c61-b0f4-487c25e6a709 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.613647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 203/397] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Oct 10 11:47:25 2022] PUT /identity/v3/projects/a3e0239b8ed2442892410300591841f2/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:25.647512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.648137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.648418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.648689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.649523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:25.649837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.651547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c50f-7cf2-4fef-9b61-fa17ca7aaa23 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.663831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 195/398] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:25.669910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.814438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900495e-114d-44b2-a2ac-04c17eb854e7 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.814698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900495e-114d-44b2-a2ac-04c17eb854e7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.815175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900495e-114d-44b2-a2ac-04c17eb854e7 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.816261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 196/399] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:25.823107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.823385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.823707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.852341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:25.853586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:25.859907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.868248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f703440-801b-431e-8a2d-feb045382a26 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.922150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.923331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.923625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.923897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.925199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.926895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.931235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 204/400] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:25.938295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.939697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.952410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 197/401] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:26.096937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4bf72-7ef8-460c-825b-691faa9d2766 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.151601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.152256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.152534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.152827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.154027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.155568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.157558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 205/402] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.165090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.331005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac938962-97cf-4b4e-936a-30bf9ca7a46f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.353386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.387603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.388303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.388586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.388864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.390880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=02cd5fa546554b3d9b2281d365cb1a2c, group_id=2cac7ab3bfc3402ca8fe5170afd3ce37, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.392354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.402239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.519363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 198/403] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Oct 10 11:47:26 2022] PUT /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:26.526816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b660-75b1-4242-9210-e56e3ade35df None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.604018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.605425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.605981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.606494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.631338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:26.643238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:26.644196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:26.644973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:26.646136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 206/404] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:26.655317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.757784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.829827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275d190-8aa9-4174-9b96-9713440a25c7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.894863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.895793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.896811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.897337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.898532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.899055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.901565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0043e8-0032-4026-8e93-6079fc24e5ba None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.917342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 199/405] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.924704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.109767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.125793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978b927-bc66-4b5c-88f0-b51aa0cfbd79 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.153068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ffa-7fa8-44cb-8f47-f850cd6ee601 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.153642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ffa-7fa8-44cb-8f47-f850cd6ee601 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.154362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ffa-7fa8-44cb-8f47-f850cd6ee601 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.158250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 200/406] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:27.171231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.171724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.172218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.219905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.221106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.221600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.222113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.225190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.232092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.236134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 207/407] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:27.237994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:27.240717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:27.246554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.418726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 201/408] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:27.502636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c077ead-1093-47ff-85f2-b317462a57c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.571521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.572566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.573031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.573513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.579068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.582057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.584946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 208/409] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:27 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:27.591109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.679157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.757968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58cd2-a491-4130-8af1-a647e08c2ac7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.811831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.812504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.812782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.813054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.815325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] RBAC: Authorizing `identity:create_grant(project_id=02cd5fa546554b3d9b2281d365cb1a2c, group_id=2cac7ab3bfc3402ca8fe5170afd3ce37, role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.816800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.909840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 202/410] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Oct 10 11:47:27 2022] PUT /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c/groups/2cac7ab3bfc3402ca8fe5170afd3ce37/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:27.926883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.978732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:28.091211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd04d65-97a9-4316-8ed2-8e143a8dbf80 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:28.133079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc627e3-6468-4ffd-b116-a649f6bc88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:28.133782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc627e3-6468-4ffd-b116-a649f6bc88aa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.134097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc627e3-6468-4ffd-b116-a649f6bc88aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.134425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc627e3-6468-4ffd-b116-a649f6bc88aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.147184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc627e3-6468-4ffd-b116-a649f6bc88aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0dc627e3-6468-4ffd-b116-a649f6bc88aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:28.152225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:28.153145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:28.154397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 209/411] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:28.163434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:28.287372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4baae1-b59e-49c6-a078-ece3e4d828da None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:28.290219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:28.361828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c5ce-ae38-4884-aa06-eded87a8edcc None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.362375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c5ce-ae38-4884-aa06-eded87a8edcc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.362864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c5ce-ae38-4884-aa06-eded87a8edcc None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.365717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 210/412] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:28.371626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.371940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.372184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.373440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:28.374532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.375039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.375525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.376782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:28.377333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:28.379844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:28.398063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 203/413] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:28.408226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:28.410748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:28.412531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:28.502049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 211/414] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:28.650379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e6542-d849-4054-8b56-b1385c99aee7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:28.723493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:28.725186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.725690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.726444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] PATH_INFO: `/v3/groups/2a10d92ae7184c59963d55ea3cff0d39` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.731443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] RBAC: Authorizing `identity:get_group(group_id=2a10d92ae7184c59963d55ea3cff0d39)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:28.734240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:28.738232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 204/415] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:28 2022] GET /identity/v3/groups/2a10d92ae7184c59963d55ea3cff0d39 => generated 229 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:28.747018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:28.768135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:28.831033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:28.876535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4897a-66fd-42b7-9b24-ec5c908d4658 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:28.903082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:28.914321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912de6b-3fd7-43e9-adfb-5a8a3af0d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:28.915632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912de6b-3fd7-43e9-adfb-5a8a3af0d90b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.915632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912de6b-3fd7-43e9-adfb-5a8a3af0d90b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.915632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912de6b-3fd7-43e9-adfb-5a8a3af0d90b None admin] PATH_INFO: `/v3/projects/8cf9335e1dea43c7bd781d2850348eb6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.916797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912de6b-3fd7-43e9-adfb-5a8a3af0d90b None admin] RBAC: Authorizing `identity:get_project(project_id=8cf9335e1dea43c7bd781d2850348eb6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:28.919086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912de6b-3fd7-43e9-adfb-5a8a3af0d90b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:28.920542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 212/416] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:28 2022] GET /identity/v3/projects/8cf9335e1dea43c7bd781d2850348eb6 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:28.926889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268310e-216a-4974-8efa-c3cf5b8109b1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.927167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268310e-216a-4974-8efa-c3cf5b8109b1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.927498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268310e-216a-4974-8efa-c3cf5b8109b1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.929217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 213/417] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:28.930154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268310e-216a-4974-8efa-c3cf5b8109b1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.027929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:29.045013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268310e-216a-4974-8efa-c3cf5b8109b1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.053365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ade6-53b4-47ba-a1b0-d3e8849f37c2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.083558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88183b-f494-4e76-94f4-82c5b18d5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.084712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88183b-f494-4e76-94f4-82c5b18d5f46 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.084993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88183b-f494-4e76-94f4-82c5b18d5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.085266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88183b-f494-4e76-94f4-82c5b18d5f46 None admin] PATH_INFO: `/v3/projects/8cf9335e1dea43c7bd781d2850348eb6/groups/2a10d92ae7184c59963d55ea3cff0d39/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.087556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88183b-f494-4e76-94f4-82c5b18d5f46 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cf9335e1dea43c7bd781d2850348eb6, group_id=2a10d92ae7184c59963d55ea3cff0d39, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.088956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88183b-f494-4e76-94f4-82c5b18d5f46 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.125650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.127391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.128249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.129369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.151020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:29.156265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 214/418] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Oct 10 11:47:28 2022] PUT /identity/v3/projects/8cf9335e1dea43c7bd781d2850348eb6/groups/2a10d92ae7184c59963d55ea3cff0d39/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:29.157138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.157422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.162713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:29.165472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:29.169565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:29.172362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:29.176365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 205/419] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:29.187612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.192503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:29.197892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:29.289101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 215/420] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:29.399285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:29.406715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab7aab-0022-4ec6-96ba-30bc781a09eb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.445674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.446403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.446692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.446974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.447674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:29.447993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.449456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77217f6-1002-48c6-9592-d1d2a64936ca None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.470026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 206/421] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:29.472428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.593116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:29.627887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78756c-b573-4922-8008-de669118445b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.628174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78756c-b573-4922-8008-de669118445b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.628706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78756c-b573-4922-8008-de669118445b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.630095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 207/422] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:29.636640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac63f4-ddfa-49ed-bbe1-81cdaa0fcf9f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.637694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77568305-4fac-4884-83dc-b5115169288c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.638607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77568305-4fac-4884-83dc-b5115169288c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.638607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77568305-4fac-4884-83dc-b5115169288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.662632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-77568305-4fac-4884-83dc-b5115169288c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:29.663797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-77568305-4fac-4884-83dc-b5115169288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:29.717147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.718053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.718572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.718987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.795401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 208/423] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:29.796707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77568305-4fac-4884-83dc-b5115169288c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.859366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.863493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:30.025515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.054021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77568305-4fac-4884-83dc-b5115169288c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.084374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.122317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.123381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.123890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.124264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.137808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 216/424] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:30.142937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.145589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:30.156497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:30.157463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:30.158301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:30.158915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 209/425] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:30.164637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.267336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8deb23-6217-4dd8-827d-8645111d9720 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.313005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.314025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.314504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.314969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.329348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:30.334773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:30.335713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:47:30.336488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:30.343650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 217/426] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:30.343650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.374962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08ceed-0ec5-4312-bef3-00f799afa475 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.391784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.440667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.441700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.442219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.443410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.445300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:30.447395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:30.457793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 210/427] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:30.461723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.496122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.504056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889b92-4637-4877-9ee7-67c9bbdd453e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.550207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.551100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.551530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.552458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.553296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:30.553745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:30.555827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:30.572308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 218/428] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:30.572308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.638707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9601-443b-4e42-95e6-90c64ba301e9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.696374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.697379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.697892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.698326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.699358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:30.699945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:30.706304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:30.718929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 211/429] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:30.720951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.730370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.735063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da16e0-a887-4516-99f8-b56aabd6b3b9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.779392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.780232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.780610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.780985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.782418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:30.785109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:30.787640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 219/430] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:30.789547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:30.841230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.874888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58209a0-50ee-4d34-90c6-b398c9bc44dc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:30.915162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdde36-d395-42a7-828e-89dfde027140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:30.916139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdde36-d395-42a7-828e-89dfde027140 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.916660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdde36-d395-42a7-828e-89dfde027140 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.917071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdde36-d395-42a7-828e-89dfde027140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.943500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc024a5-4255-4409-8766-51b571fda331 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.008047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.009148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.009656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.010158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.020336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdde36-d395-42a7-828e-89dfde027140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.023858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdde36-d395-42a7-828e-89dfde027140 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.051553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.098729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.100841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.136803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.171852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 212/431] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:31.173468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c89c8-24f5-42d4-8840-2670740d9a39 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.173761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c89c8-24f5-42d4-8840-2670740d9a39 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.174062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c89c8-24f5-42d4-8840-2670740d9a39 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.177908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 213/432] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:31.177908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c89c8-24f5-42d4-8840-2670740d9a39 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.249045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 220/433] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:31.251245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.310322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c89c8-24f5-42d4-8840-2670740d9a39 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.334889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.357344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.358042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.358326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.358601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.359782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=a3e0239b8ed2442892410300591841f2) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:31.360305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.362724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26cc9-164a-4003-b9aa-17f1e031eb5f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.372464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 214/434] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.374607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.375105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.375583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.401433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c46f3-dd5b-42d5-bbe6-7b2e14011c98 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.405596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:31.407227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:31.450479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.452177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.453059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.453551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] PATH_INFO: `/v3/projects/a3e0239b8ed2442892410300591841f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.455247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e0239b8ed2442892410300591841f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.457049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.459839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 221/435] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/projects/a3e0239b8ed2442892410300591841f2 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.461001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.485733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.558479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 215/436] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:31.558479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.675501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b3c3-d98e-425f-92ae-8ecfe7e40056 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.736623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642bc6-79b5-42b4-b21b-9b390e4c53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.737281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642bc6-79b5-42b4-b21b-9b390e4c53f8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.737563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642bc6-79b5-42b4-b21b-9b390e4c53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.737956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642bc6-79b5-42b4-b21b-9b390e4c53f8 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.738896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba951df2-50c4-42d3-80bf-38dde50ed306 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.740126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642bc6-79b5-42b4-b21b-9b390e4c53f8 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.741797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642bc6-79b5-42b4-b21b-9b390e4c53f8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.746065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 222/437] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.748184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b669e-5ed3-4ecf-a11d-57dbb531d9e9 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.748698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b669e-5ed3-4ecf-a11d-57dbb531d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.749147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b669e-5ed3-4ecf-a11d-57dbb531d9e9 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.753119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 223/438] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:31.761587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.761952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.762399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.770201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.781624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.782322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.782653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.782875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.783547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:31.784008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.784758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:31.785453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.792337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 216/439] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.792337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.854703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.884266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 224/440] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:31.885400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.939866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719e499-723a-4512-82ce-73e39eff2515 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.978605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.979249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.979533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.979810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.980970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.982542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.984318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 217/441] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.984938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.023574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744cf09-41e4-4141-9788-e43ae9155c39 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.062093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.070833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.074637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.074637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.074637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.074637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=a3e0239b8ed2442892410300591841f2) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.074637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.076207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.089891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 225/442] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=a3e0239b8ed2442892410300591841f2&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.089891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.134696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3a9f7-98d6-420e-958b-3488f8a6b2a4 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.150669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.186713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.187407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.187691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.188006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.204092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:32.211927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:32.212900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:32.213673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:32.214303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 218/443] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:32.215089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.219721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3588-73bf-4b10-a0e5-b90bf7944eb0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.265253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.266000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.266303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.266432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.267181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=7acb4f2b69ec4c21a3c969d994c72845, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.267491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.268991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.285192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 226/444] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=7acb4f2b69ec4c21a3c969d994c72845 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.285192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.370552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.380575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f549f7-5faf-47dc-867c-87a06e034fa1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.436748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.437517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.437796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.439285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.447832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acce0e-4f28-4391-aedc-2ca8e8d267be None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.455753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:32.463502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:32.465342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:32.467038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 219/445] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:32.477018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.517451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.517911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.518152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.518397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.519100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.519494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.521363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.532883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 227/446] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.539330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.542965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.642308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4200c97-892b-438b-bdc1-409a03862cfc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.692449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.693686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.694006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.694287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.694992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.695301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.697016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.707228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 220/447] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:32.716330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.719217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db978bf-5894-4e5b-abbd-ec9fc8365f02 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.752176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.768968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.770035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.770530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.771561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.854727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.876370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60851e62-806f-4751-9347-b89f5e65d573 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.877824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.881027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.927911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.928536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.928825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.929098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.019894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.021932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.038671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 228/448] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:33.046925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.076567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.144052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.169431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 221/449] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:33.172231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.174103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e5296-c652-42c4-9fd4-941015a8f426 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.218363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.219021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.219292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.219564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] PATH_INFO: `/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.220817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] RBAC: Authorizing `identity:get_project(project_id=02cd5fa546554b3d9b2281d365cb1a2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.222364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.224128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 229/450] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/projects/02cd5fa546554b3d9b2281d365cb1a2c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:33.230450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.327079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952440-9c58-4c82-ae7b-4cea8c56d0b1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.333122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.346272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb854-c1a7-4caf-80b6-385ddd2f3382 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.369382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.370089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.370380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.370729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] PATH_INFO: `/v3/projects/8cf9335e1dea43c7bd781d2850348eb6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.372282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] RBAC: Authorizing `identity:get_project(project_id=8cf9335e1dea43c7bd781d2850348eb6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.374273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.376162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 222/451] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/projects/8cf9335e1dea43c7bd781d2850348eb6 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:33.383040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.388405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.389405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.389881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.390421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] PATH_INFO: `/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.392225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] RBAC: Authorizing `identity:get_group(group_id=2cac7ab3bfc3402ca8fe5170afd3ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.394926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.397316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 230/452] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/groups/2cac7ab3bfc3402ca8fe5170afd3ce37 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:33.407461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.470930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.522341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c91396-6289-4216-baa0-9545df3ea250 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.549549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab544-0866-464a-9bbe-abc0367ad1ca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.565539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.566346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.566744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.567153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] PATH_INFO: `/v3/groups/2a10d92ae7184c59963d55ea3cff0d39` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.568949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] RBAC: Authorizing `identity:get_group(group_id=2a10d92ae7184c59963d55ea3cff0d39)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.570564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.572306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 223/453] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/groups/2a10d92ae7184c59963d55ea3cff0d39 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:33.579093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.597907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.598825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.599275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.599723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.600945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] RBAC: Adding query filter params (group.id=2cac7ab3bfc3402ca8fe5170afd3ce37, role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:33.601451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.603827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f22fc-8527-42a6-99f2-19bbf21b478a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.613613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 231/454] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/role_assignments?group.id=2cac7ab3bfc3402ca8fe5170afd3ce37&scope.project.id=02cd5fa546554b3d9b2281d365cb1a2c&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:33.710964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e7c63-9862-48e7-9bf6-297a82a4aa01 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.741160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.754317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.755007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.755908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.756216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.757174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] RBAC: Adding query filter params (group.id=2a10d92ae7184c59963d55ea3cff0d39, role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=8cf9335e1dea43c7bd781d2850348eb6) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:33.757502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.759139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2b0b-8c72-4f4b-9fe3-7ce72c34d9de None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.766696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 224/455] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/role_assignments?group.id=2a10d92ae7184c59963d55ea3cff0d39&scope.project.id=8cf9335e1dea43c7bd781d2850348eb6&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:36.428511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff5a2-9700-4aa7-9a43-948ca73a088f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.429037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff5a2-9700-4aa7-9a43-948ca73a088f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.429037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ff5a2-9700-4aa7-9a43-948ca73a088f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.430781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 232/456] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:36.436753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.437292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.437292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.470539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:36.471780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:36.580160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 225/457] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:37.121961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ff5a2-9700-4aa7-9a43-948ca73a088f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.180585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.354800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ff5a2-9700-4aa7-9a43-948ca73a088f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.427699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.428654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.429518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.429645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.466555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.469078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:37.498115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:37.499965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:37.502827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:37.502827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:37.502827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:37.502827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 233/458] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:37.507752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.727483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8ba3-f90d-4648-87fa-c1765a39508a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.768886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.806013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.806732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.807013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.807287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.807976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:37.808282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.809787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9c1f-2f3d-4bbb-b6d4-11a63b446bd5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.825176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 226/459] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:37.830833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.846217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a598ab-b5b7-4694-b1fc-9afd1116c0cc None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.846620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a598ab-b5b7-4694-b1fc-9afd1116c0cc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.846798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a598ab-b5b7-4694-b1fc-9afd1116c0cc None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.850034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 227/460] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:37.854363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d4d0-d431-408e-bdcc-6e6996a01846 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.854574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d4d0-d431-408e-bdcc-6e6996a01846 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.854867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d4d0-d431-408e-bdcc-6e6996a01846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.890940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a6a8d4d0-d431-408e-bdcc-6e6996a01846 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:37.892437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a6a8d4d0-d431-408e-bdcc-6e6996a01846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:37.926401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.959707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f53b3-a328-4b9c-99bd-2fa89b5859f5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.002223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 228/461] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:38.004189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4aa0c-699e-49aa-a94f-d53965b02f67 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.005037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4aa0c-699e-49aa-a94f-d53965b02f67 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.005309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4aa0c-699e-49aa-a94f-d53965b02f67 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.007791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 229/462] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:38.009429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6194d-de09-42ae-a7c6-dc97992f9915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.010076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6194d-de09-42ae-a7c6-dc97992f9915 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.010354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6194d-de09-42ae-a7c6-dc97992f9915 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.010625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6194d-de09-42ae-a7c6-dc97992f9915 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.011387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6194d-de09-42ae-a7c6-dc97992f9915 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.012849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6194d-de09-42ae-a7c6-dc97992f9915 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.020275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.020607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.020876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.047658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:38.048904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:38.126650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 230/463] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:38.145631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 234/464] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:37 2022] POST /identity/v3/users => generated 246 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:38.345931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.352542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a039ca0-1772-4f17-93b4-d9edc4a26776 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.352869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a039ca0-1772-4f17-93b4-d9edc4a26776 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.353076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a039ca0-1772-4f17-93b4-d9edc4a26776 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.354814 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 235/465] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:38.364466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.364776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.364993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.399700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:38.402531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:38.437460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.521427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c85a4c-68ca-42d2-89d1-42aa253ab0aa None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.523716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 236/466] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:38.525066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.566900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.567588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.567861 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.568132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.580259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.581730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:38.601512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:38.602592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:38.603540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:38.603540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:38.603540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:38.603540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 231/467] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:38.609030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.615998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.688440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4f7be-0666-4b38-bf8d-b74c5a42d572 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.737006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.737925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.738710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.739740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.740631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.751128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d69a1-a587-4bab-9e43-de915453a02a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.758111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.759870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:38.783845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:38.784970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:38.785916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:38.785916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:38.785916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:38.787596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 237/468] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:38.797611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.810868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.811563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.811851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.812129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.812858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:38.813166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.814668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfefd3-2630-4e69-a4e2-aa1efcd0add6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.832555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 232/469] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:38.834537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794445f9-db97-4639-9463-eebbf0bd7f28 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.834834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794445f9-db97-4639-9463-eebbf0bd7f28 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.835113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794445f9-db97-4639-9463-eebbf0bd7f28 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.841950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 233/470] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:38.843217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794445f9-db97-4639-9463-eebbf0bd7f28 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.947411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fd397-11d7-41a0-9293-3ea3a8e1d2d7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.965912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.990900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.991604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.991944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.992292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.993012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:38.993375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.995228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e5f3d-c4b8-4f2b-95ae-c08cf965e777 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.010359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 238/471] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:39.011645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.011930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.012205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.032035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:39.033260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:39.049336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794445f9-db97-4639-9463-eebbf0bd7f28 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.104456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.105075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.105355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.105632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.106317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.107786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.139591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 239/472] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:39.141455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.201735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 234/473] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:38 2022] POST /identity/v3/users => generated 248 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:39.201735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.240798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.441289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba0a4-49d9-43a1-a8c5-4e2205bed871 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.443647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.468963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ee22-64a7-487f-affa-31e8b4f96bbb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.499995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.502937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.503695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.504193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.525441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.527017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.527918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.528370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.529038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.529516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.530432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.532770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:39.552523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:39.567530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:39.568592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:39.568592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:39.568592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:39.568592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 240/474] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:39.568592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.633808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 235/475] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/users => generated 249 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:39.635179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.718169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea169-e0ca-4eba-b7ca-c70a65a80db6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.769632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.770383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.771299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.771574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.772306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.774099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.775570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.836773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7edd-1e3b-4667-84d7-6f649ab1cde8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.840520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.sql.core [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 11:47:39.840520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 10 11:47:39.840520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [parameters: {'id': '1a5d46a9b50946179c400a32f68cb036', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 10 11:47:39.840520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Oct 10 11:47:39.865506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return ref.to_dict() Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:47:39.866602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application yield resource Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise self.value Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application session.commit() Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 11:47:39.867648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.flush() Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application compat.raise_( Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 11:47:39.868564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:47:39.869519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:47:39.870473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [parameters: {'id': '1a5d46a9b50946179c400a32f68cb036', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:39.871261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 10 11:47:39.872247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:39.880855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 241/476] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/roles => generated 144 bytes in 326 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:39.887175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.916861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.942923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.943583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.943873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.944154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.944842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:39.945153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.946642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.962237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 236/477] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:39.967947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:40.043965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c1984-ceaf-4e0d-937f-b3d7e542b860 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.121920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.124210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.125390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.126103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.139384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b794c7-1d2c-4ee7-ad8e-b1b6cd7db246 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.149139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:40.162552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:40.163521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:47:40.164305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:40.165405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 242/478] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:40.171357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:40.173121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:40.194472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facdca6-ae7d-4156-91c8-0416ea579414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.195223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdca6-ae7d-4156-91c8-0416ea579414 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.195511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdca6-ae7d-4156-91c8-0416ea579414 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.195784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdca6-ae7d-4156-91c8-0416ea579414 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.196471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facdca6-ae7d-4156-91c8-0416ea579414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:40.198042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facdca6-ae7d-4156-91c8-0416ea579414 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:40.332995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 237/479] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/users => generated 248 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:40.336427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:40.382537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560820b-365b-49d8-961b-04ea30975112 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.451904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.453102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.453476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.454017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.455302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:40.455850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:40.458726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b277020-a7cc-439c-801b-f99a6eb142f6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:40.476140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 243/480] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:41.068969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e78261-42fd-48da-a073-471486a76f29 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.070037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e78261-42fd-48da-a073-471486a76f29 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.070557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e78261-42fd-48da-a073-471486a76f29 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.072532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 238/481] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:41.078565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.079508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.080001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.101418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:41.103117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:41.247227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 244/482] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:41.733695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e78261-42fd-48da-a073-471486a76f29 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.952547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e78261-42fd-48da-a073-471486a76f29 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.038304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cada6a8-d7df-4895-b5e4-f611aa24327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.040232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cada6a8-d7df-4895-b5e4-f611aa24327a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.041103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cada6a8-d7df-4895-b5e4-f611aa24327a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.041923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cada6a8-d7df-4895-b5e4-f611aa24327a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.062563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cada6a8-d7df-4895-b5e4-f611aa24327a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2cada6a8-d7df-4895-b5e4-f611aa24327a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:42.074280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:42.076773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:42.078457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:42.082880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 239/483] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:42.092851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.188887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef706b7-fcb5-4105-a2e3-4f5be2481e28 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.189651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef706b7-fcb5-4105-a2e3-4f5be2481e28 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.190343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef706b7-fcb5-4105-a2e3-4f5be2481e28 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.193945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 240/484] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:42.203390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5e0f-84d7-46f5-bf09-bcc28a31436d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.204328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5e0f-84d7-46f5-bf09-bcc28a31436d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.205063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5e0f-84d7-46f5-bf09-bcc28a31436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.216316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.239809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-08dc5e0f-84d7-46f5-bf09-bcc28a31436d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:42.242521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-08dc5e0f-84d7-46f5-bf09-bcc28a31436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:42.268930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301364c1-b358-4b5e-8846-71fcf8f2bab6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.329296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.359746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.360352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.360631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.360904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.361581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.361895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.363305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.390520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 245/485] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:42.414095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.458033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 241/486] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:42.464281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c5a8-f6a3-458c-960b-06446f9df1ec None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.464754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c5a8-f6a3-458c-960b-06446f9df1ec None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.465531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c5a8-f6a3-458c-960b-06446f9df1ec None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.468137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 242/487] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:42.476405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.476873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.477359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.525673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:42.528821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:42.613176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c183de-633b-46f1-aacc-c98b5e3ecd40 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.659809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 243/488] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:42.668258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.683268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.683927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.684207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.684481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.696132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.697630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:42.717122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:42.718147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:42.718984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:42.718984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:42.718984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:42.718984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 246/489] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:42.729701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.863416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.867643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d437d8-7723-4b37-918b-50bea3e748b7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.917111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.917737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.918038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.918313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.918966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.919265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.920651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.937222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 244/490] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:42.945460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.973204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.114898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39198f-4418-461e-8a1e-4191d4626b02 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.153557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.154242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.154527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.154803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.164541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc01b3-384e-4121-bbda-c17d788cb701 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.166529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:43.172066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:43.173797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 245/491] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:43.176035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.197373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.245159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.246757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.247537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.248364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.265773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.269558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.288296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f233a1-2a72-4fb9-9df6-bd747bdcd0bd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:43.297460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:43.299351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:43.301076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:43.312898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 247/492] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:43.315076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.329961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.330619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.330938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.331393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.345138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:43.351497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:43.353207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 246/493] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:43.354803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.424111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.455999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.484712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fefe0d-e0dd-46d6-9dab-ddfd353e94ed None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.527289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.528099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.528547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.528828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121670dd-0b27-41ba-9906-afd8933dbc4a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.529078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.530007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:43.530718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.533546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.572495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.573290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.573696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.574159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.574978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:43.575436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.578047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d74b-e84a-45eb-8a35-f1f21166fccb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.580110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 247/494] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:43.581141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.594675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 248/495] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:43.596321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4339c2-d06c-4677-8272-99622951c81d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.596737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4339c2-d06c-4677-8272-99622951c81d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.597140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4339c2-d06c-4677-8272-99622951c81d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.599876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 249/496] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:43.600469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4339c2-d06c-4677-8272-99622951c81d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.754661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6e9c-3748-4f98-bba3-427904a21446 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.770788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4339c2-d06c-4677-8272-99622951c81d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.782444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.807779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.808528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.808894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.809254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.810060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:43.810445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.811946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.814554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.818359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19e90-a7b3-45d2-9b59-5d1791767419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.819051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19e90-a7b3-45d2-9b59-5d1791767419 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.819403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19e90-a7b3-45d2-9b59-5d1791767419 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.819734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19e90-a7b3-45d2-9b59-5d1791767419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.822048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 248/497] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:43.822895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.897639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19e90-a7b3-45d2-9b59-5d1791767419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.899353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19e90-a7b3-45d2-9b59-5d1791767419 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.929781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714762c5-2a31-413b-83ae-9801c88a2c8c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.968280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.968986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.969258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.969526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.981080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.982666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-bbcd8051-824d-450b-b8b0-9c3ffc6c17cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:43.998447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:43.999404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:44.000229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:44.000229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.000229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:44.000229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 249/498] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:44.001373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.001700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.002062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.019496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 250/499] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:44.019496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87688744-49f6-4ac0-b7bd-a1011387547e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.019496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87688744-49f6-4ac0-b7bd-a1011387547e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.019496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87688744-49f6-4ac0-b7bd-a1011387547e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.019496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 251/500] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:44.019496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87688744-49f6-4ac0-b7bd-a1011387547e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.024179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:44.025402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:44.028427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:44.077148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:44.118586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 250/501] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:44.118586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.134706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87688744-49f6-4ac0-b7bd-a1011387547e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.184279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.186541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.187144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.187631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.207047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.210319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.218326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5c9e-f0e6-41c0-b446-05f95dc01bd8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ec04f4d7-da8a-4284-a549-5ce03f999be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:44.237839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:44.238852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:44.239699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:44.239699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.239699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:44.240451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 252/502] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:44.242194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.242682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.243162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.264164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.264823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.265097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.265371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.266070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:44.266373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.267739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.274467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:44.276779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:44.280126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 251/503] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:44.281022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.324852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:44.376214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:44.391289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 253/504] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:44.391730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43664620-0f17-443d-b602-9cd5c381effa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.392179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.465732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.466586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.466990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.467388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.487105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.489989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:44.517743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:44.519714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:44.522431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:44.522431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.522431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:44.528936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 252/505] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:44.528936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.590911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5b2c4-e2fb-49e0-b8b9-29e0dcfff7da None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.647017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.647636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.647920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.648198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.648855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:44.649293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.651077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.663112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 254/506] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:44.663978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.669339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:44.681240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c884-3afe-46a5-a580-f2a18665b6bc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.735018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.735993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.736470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.736924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.747742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:44.749435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.752015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:44.775237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:44.776442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 253/507] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:44.782408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.825330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ae38f-3242-4a6f-8c77-5657a6cadf35 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.862812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.863459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.863729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.863998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.877035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.878822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:44.894122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:44.895787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:44.897344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:44.897344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:44.897344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:44.897344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 255/508] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:44.897344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:44.912387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b3b6-8ea2-4603-929d-2cc249e44252 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:44.955458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:44.956228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:44.956601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:44.956972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:44.957718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:44.958785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:44.960554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:44.975877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 254/509] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:44.977055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.001449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.030173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.033749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf0ec-d7ce-4acd-9aac-c90411a35c81 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.092232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.093297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.093793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.094318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.105761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97b8ab-107e-4f0c-9711-930cf02a9eb3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.108300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.110934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:45.132968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:45.134955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:45.136292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 256/510] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:45.136860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.147747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.148372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.148656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.148926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.160703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:45.166359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:45.167769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 255/511] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:45.169358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.256309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.299297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f05dd-4123-4937-b54c-e36a67f1fe85 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.306553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06747d-7166-4b5b-9fbc-1c48eec5b398 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.339938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.340928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.341406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.341895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.343243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:45.343778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.346392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.346613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.347008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.347291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.347567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.348213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:45.349097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.350513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.362783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 256/512] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:45.363685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.422749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 257/513] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:45.422749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.454932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.483307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30731d41-bf49-4043-b676-d3f5aa985184 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.517048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.522658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.523302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.523580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.523852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.532886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.534533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:45.551195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:45.553469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 257/514] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:45.556183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.570131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e32e6-5c48-4a71-82d0-cc3eac3d30b6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.620833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.621841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.621841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.622081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.622711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:45.623352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.624458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.644190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 258/515] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:45.645032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.682347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50ddc1-c926-447f-b7bb-9cf5033fc9b0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.732222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.734349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.735174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.735460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.735755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.736631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:45.736981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.739085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.750073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 258/516] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:45.750952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.760147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084b09-5031-4b21-b361-c29a831f2af9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.816837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.818248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.818693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.819135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.820132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.822566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.842761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.894259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a93b6-6969-4f91-b180-3ef8a53dc7c5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.920123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 259/517] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:45 2022] POST /identity/v3/users => generated 247 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:45.920980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.951255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.951940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.952202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.952473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.036704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.038419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.125790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a24ed-e032-4d0b-80d1-d0a476edc477 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.132726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.185221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.192033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.192641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.192918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.193296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.193921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.200440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.200440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.221179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 259/518] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:46.224369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.231194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 260/519] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:46.232226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.357219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01410-8c31-4163-9e0a-c01122bba73b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.382496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0dfb8-ed6a-49b7-8bea-25a3b2137fa1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.397471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.398548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.399055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.399535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.426457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.427918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.428202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.428479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.431230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.443083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.455329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:46.460301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:46.461606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:46.462807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:46.462807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:46.462807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:46.462807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 261/520] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:46.462807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.492690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.494460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.534465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.628204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 260/521] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:46.629212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.655865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b178057-689a-443b-b0ea-3c23f7373547 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.699509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.730058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.731109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.731609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.732114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.733346 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6384fbfdbff1461594e0e4f877bc8e5e) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.733842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.736207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.744510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 262/522] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/role_assignments?user.id=6384fbfdbff1461594e0e4f877bc8e5e&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:46.746195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.772854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643eb9c2-ff26-4f85-9e5e-a4764a208609 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.866246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.868253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.869038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.869808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.897080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.900634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:46.940507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:46.941422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:46.942442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:46.942442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:46.942442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:46.948652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 261/523] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:46.949962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.974728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfe842-20b0-4402-bf33-e3bd37a8e1dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.999805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:47.044994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.047180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.049272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.050734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.052158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:47.052872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.057494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.092467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6afdf9-da9d-4a1c-a35b-4586bc1af0be None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:47.100840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 263/524] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:47.100840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:47.109250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:47.165803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.167223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.167909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.168668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.189341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.193039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.220065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986651df-90e2-4da0-9758-8727ae826eeb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:47.222447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:47.224661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:47.226563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:47.226563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:47.226563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:47.229534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 262/525] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:47.231374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:47.266564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.267347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.267729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.268109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.268873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:47.269301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.270954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.286272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 264/526] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:47.286272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:47.318707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:47.450417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dbc6-addc-400b-a598-0f858cddb546 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:47.462278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209d98-53ff-4ab8-b262-07f0a03403c8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:47.529956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.531124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.531423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.531790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.532391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.532493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.532925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.533411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.533841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:47.534517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.537834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.548378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.551154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.561721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 265/527] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:47.563238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:47.573201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:47.574188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:47:47.575050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:47.575715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 263/528] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:47.577130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:47.622310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:47.745006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:47.769805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cee47-d735-4c0f-9a8f-0190ba3e02e1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:47.792485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246eff8-5d7a-4fc0-b3d3-4cfeb33e7e59 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:47.850493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.852345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.852837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.853707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.866387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:47.867835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:47.868551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:47.868811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.869447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:47.872276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.885514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:47.888747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:47.900372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:47.902222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:47.904020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:47.914066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 266/529] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:47.915890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:47.918737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:47.920442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:47.922301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:47.930466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 264/530] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:47.935755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.099668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.141831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6662c-8b38-4d9a-b114-274df91ddcbc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.165895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b208148-6b97-4f4a-b20a-c7c2e253b040 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.218150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.219761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.220505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.221264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.222958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:48.225125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.228501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.247253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.248296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.248794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.249285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.250716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:48.251286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.256147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.270459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 265/531] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:48.272629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.310001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 267/532] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Oct 10 11:47:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:48.312213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.332637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.476602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c23e7-2556-43fe-8181-911e7f243a27 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.509118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6511412-6811-4749-beb8-20c1a34a8ad0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.522306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.523486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.523968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.524453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.525745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:48.526338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.529121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.541656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.552168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 266/533] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:48.553652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.562752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.563780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.564277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.566124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.566272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=aa49e174aaa14829a0281441a834ef4a) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:48.566825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.570124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f33c71-a487-47ee-bc46-65f066d8cebd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.580175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 268/534] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:48 2022] GET /identity/v3/role_assignments?user.id=aa49e174aaa14829a0281441a834ef4a&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:48.581738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf92e08-70fe-4827-b2c7-7b8fa0a62886 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.582069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf92e08-70fe-4827-b2c7-7b8fa0a62886 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.582312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf92e08-70fe-4827-b2c7-7b8fa0a62886 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.583958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 269/535] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:48.588970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf92e08-70fe-4827-b2c7-7b8fa0a62886 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.701561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.749642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf92e08-70fe-4827-b2c7-7b8fa0a62886 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.759165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15fb9e-7c19-4860-8d7a-715076f64929 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.798708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.799375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.799657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.799933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.800712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=b3e8ae06eace4634ac1a52ddab162d91) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:48.801018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.802802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee09b5-c0bc-4b5c-94c1-e249c44f203d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.810053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 270/536] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:48 2022] GET /identity/v3/role_assignments?user.id=b3e8ae06eace4634ac1a52ddab162d91&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:48.812009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.812009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.812387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.837111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:48.838601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:48.844414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.845751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.846404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.847024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.931366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 271/537] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:48.987300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.995877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.998963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.211036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 267/538] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:49.219731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.260667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.341515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.390740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94954ca4-a5d3-4532-b8da-b538a1b97d1d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.414063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.419870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a909338-a63a-48a3-a844-7018955e8efb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.437751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.438427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.438706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.438972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.455383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.461983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.476725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582ed5-7e6d-4e77-83d6-38f7a4cb097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.477376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582ed5-7e6d-4e77-83d6-38f7a4cb097e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.477655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582ed5-7e6d-4e77-83d6-38f7a4cb097e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.477961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582ed5-7e6d-4e77-83d6-38f7a4cb097e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-834bb18c-fbf4-4284-b62a-0dd5eb40e1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:49.483863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:49.484989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:49.486061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:49.486061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:49.486061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:49.492687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 272/539] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:49.492687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af463082-6b41-4eba-9644-244ec2637244 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.492687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af463082-6b41-4eba-9644-244ec2637244 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.492687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af463082-6b41-4eba-9644-244ec2637244 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.494193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 273/540] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:49.495304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af463082-6b41-4eba-9644-244ec2637244 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.503164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7582ed5-7e6d-4e77-83d6-38f7a4cb097e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a7582ed5-7e6d-4e77-83d6-38f7a4cb097e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:49.509563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:49.510527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:49.511308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 268/541] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:49.517339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.517339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.517339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.538034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:49.539622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:49.621457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 269/542] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:49.623498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.641457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af463082-6b41-4eba-9644-244ec2637244 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.680211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.720114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.720806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.721316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.721817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.723000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:49.724115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.726786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.757647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 274/543] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:49.764305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.850218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.896784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a4288-a096-4a7b-ac16-3d2581466e85 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.967125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2217ab-151d-4ec1-b55f-b5f07147202a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.992196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.992745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.993021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.993292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.994006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:49.994307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.995687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.006973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 270/544] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:50.008453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.029637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.030705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.031088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.031460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.041039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.042838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:50.057887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:50.058944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:50.059947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:50.062088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 275/545] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:50.063063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.115199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.159532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265584-d609-489d-9f40-888e0869ed51 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.203136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.204192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.204797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.205298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.210548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f9562-7fc5-466a-aa55-336178759186 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.221353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:50.227308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:50.228327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:50.229520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:50.232377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 271/546] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:50.238507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.255309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.259997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.260660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.260944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.261222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.280494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.282309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:50.308627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:50.309632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:50.310527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:50.310527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:50.310527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:50.313969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 276/547] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:50.315383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.383123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f81c41-54d2-4908-9638-16fd551acdd7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.424180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.425722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.427052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.427532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.428746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:50.429735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.431537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.433295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.454262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23f70-12a8-4b72-98ab-abd3eee4b7d5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.454452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 272/548] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:50.455262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.505595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.506631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.507184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.507687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.508695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:50.509208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.511256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.527611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 277/549] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:50.529069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.538149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.570840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbe462-0b87-4025-9af6-9f4fa868871d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.609476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.610128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.610410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.610681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.611880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:50.611880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.613047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.632379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 273/550] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:50.633445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.655807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e58f8-e6fb-41a0-ab09-5880a816e4d3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.697462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.698550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.699080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.699574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.700516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=0a1bda85ce4a41ed8ec354d40ecbb08a) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:50.701118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.702986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.710973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 278/551] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/role_assignments?user.id=0a1bda85ce4a41ed8ec354d40ecbb08a&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:50.712253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.731664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.776157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f4ba5-ca20-46c8-8176-c431506dcf82 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.825354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.841130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280843f8-eaa6-4ee9-8bf7-500d0486668f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.847386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.848083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.848378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.848657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.870194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.871777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.887475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.888654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.889151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.889632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.900227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:50.901573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:50.902466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:50.903366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:50.903366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:50.903366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:50.904737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.910378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 274/552] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:50.918337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:50.923991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:50.924985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:50.926032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:50.929050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 279/553] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:50.939671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:51.055760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27385122-98c0-4f29-b0bc-ae7fcd08d96c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.104173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.104802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.105085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.105414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.106043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:51.106356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.107786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.122894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 275/554] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:51.131994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:51.141328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:51.210291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9cf9e-8d8b-48fe-b2af-66858c3fd922 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.254373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:51.300117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.301131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.302256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.302732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.304091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:51.304609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.307390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.355840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 280/555] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Oct 10 11:47:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:51.365578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:51.405563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c648-f779-4578-8a15-9a94577f66ce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.496517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.497627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.498151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.498650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.521321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.524145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:51.557564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:51.559016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:51.559936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:51.560471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 276/556] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:51.567510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:51.568167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80155f4-1996-472a-819b-cce137e92d56 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.633729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:51.644376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.646063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.647204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.647699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.792880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41210-d1b6-4f97-b5cb-94079e948298 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.795816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:51.798146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.804853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.868248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.869230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.869724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.870217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.871148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:51.871667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.880659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.915833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 277/557] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:51.919432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.060445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17cffb-d6a1-4ca4-a202-80a4edd0901a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.074175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 281/558] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:52.075983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.101477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.102558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.103083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.103578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.115372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.117264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-69f75fb5-77fe-4313-827a-fefac1b52c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:52.134816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:52.135799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:52.136696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:52.136696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:52.136696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:52.138802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 278/559] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:52.140292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517b77-7402-4b2d-91a1-71b55cece8ee None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.140578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517b77-7402-4b2d-91a1-71b55cece8ee None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.140850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517b77-7402-4b2d-91a1-71b55cece8ee None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.142487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 279/560] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:52.148220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517b77-7402-4b2d-91a1-71b55cece8ee None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.165112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.171409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.277766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517b77-7402-4b2d-91a1-71b55cece8ee None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.296448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ead00-d346-469c-9dce-847fa3f9a5f9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.344348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.344993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.345264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.345569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.348288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.349629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.350267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.350840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.352095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:52.352858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.355668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.356641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.358144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-da585f36-ac73-460e-aff3-462b6a62e98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:52.374274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:52.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 282/561] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.378636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.380515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 280/562] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:52.396935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.397741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:52.401573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:52.492868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 283/563] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:52.493898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.526603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.632904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.743695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de096587-6f74-46ee-a6e4-9d1392547427 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.838490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.839114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.839388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.839656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.840306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:52.840607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.842036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.847717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d314695-2a59-49ad-a584-4800337b2617 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.860575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 281/564] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:52.861565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.944325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.946297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.947533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.949497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.960754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.964198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.983274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd44664-7b55-4042-a7cf-998a2910becd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:52.986571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:52.987457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:52.988370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:52.989379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 284/565] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:52.990614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.033038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.041438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b159-446f-4251-b3e6-56c750897150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.042543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b159-446f-4251-b3e6-56c750897150 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.050743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b159-446f-4251-b3e6-56c750897150 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.050743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b159-446f-4251-b3e6-56c750897150 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.065176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b159-446f-4251-b3e6-56c750897150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5a43b159-446f-4251-b3e6-56c750897150 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:53.076064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:53.077064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:53.077964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:53.078600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 282/566] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:53.080237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18eb8f-b531-45f0-81b7-76782976505a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.080722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18eb8f-b531-45f0-81b7-76782976505a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.081223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18eb8f-b531-45f0-81b7-76782976505a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.086030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 283/567] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:53.086030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18eb8f-b531-45f0-81b7-76782976505a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.140559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.180845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342c04-9444-4e21-a9ad-ae99883c0360 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.235070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.235896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.236348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.236799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.248635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.251230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.251427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18eb8f-b531-45f0-81b7-76782976505a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:53.272051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:53.274083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:53.276056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:53.281943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 285/568] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:53.283510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.316950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.317685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.318081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.318455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.319247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:53.319640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.321266 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b973f-1f67-48e2-a491-b394893a0ed4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.336428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 284/569] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:53.337710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.338137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.338417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.357677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:53.359067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:53.435937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.469799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a91382-69db-4719-ab53-42725bc30b95 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.481884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 285/570] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:53.481884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.554397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.555334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.555620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.555936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.556804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:53.557357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.561050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.564655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.580543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 286/571] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:53.581803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.648180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fc99f-c935-46cb-bc9a-cdeec14b4616 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.687594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.688208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.688512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.688786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.689489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:53.689787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.691351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dabffb-7e1d-48f4-bd33-e7f189899eae None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.711684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 286/572] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:53.711684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2bc6d-2c1b-4281-b9fb-0bffd9a26f53 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.711684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2bc6d-2c1b-4281-b9fb-0bffd9a26f53 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.711684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2bc6d-2c1b-4281-b9fb-0bffd9a26f53 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.711684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 287/573] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:53.711684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2bc6d-2c1b-4281-b9fb-0bffd9a26f53 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.725426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d000a-3dd6-4d69-a554-d7abeb4f6977 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.763344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.785517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.786425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.786810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.787086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6384fbfdbff1461594e0e4f877bc8e5e/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.803627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6384fbfdbff1461594e0e4f877bc8e5e, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.805173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.830937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2bc6d-2c1b-4281-b9fb-0bffd9a26f53 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.874110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.874752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.875029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.875301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.881927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 287/574] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:53 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6384fbfdbff1461594e0e4f877bc8e5e/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:53.882878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.887812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.889334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b08bb2ba-5e93-4cfe-b71e-ad35c8d2d862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:53.907311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:53.909389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 288/575] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.911376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.933172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:53.934523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:53.965775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.019471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 289/576] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:54.021071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.034535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab3f6a-a577-4f27-925d-63257b128dc2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.067464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.076885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.077681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.078086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.078456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.079390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6738164d722a43c7b32706caef761fbe) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.079793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.081324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.089563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 288/577] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/role_assignments?user.id=6738164d722a43c7b32706caef761fbe&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:54.090285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.183692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173e65-fa1b-4e26-9f5b-483a2db06382 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.287879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.289119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.289489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.289821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.318712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03409c-3694-4037-94dd-6e5f20cf0278 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.322939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:54.332344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:54.334777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.335736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:54.337179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 290/578] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:54.343521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.372776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.373412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.373701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.374016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.374675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.374983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.376403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.394550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 289/579] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:54.396258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.484354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.503955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d3601-916d-403a-94a3-9600076e4d2c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.533304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9f64-20fa-4321-9897-63b870c70d45 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.561228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.562354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.562835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.563331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.564528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.565032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.568479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.584146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 291/580] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:54.589990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.593528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.594583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.594866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.595142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.610640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:54.616440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.617880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:54.619044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:54.622751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 290/581] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:54.623783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.668403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.747265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0fa1-2825-4d14-847a-7f228c7f9700 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.765429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53dba1-ff28-41b4-a559-5259ef4039c5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.787407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.788449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.788936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.789427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.798938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.800805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.813017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.813667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.813981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.814256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:54.816692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.818446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:47:54.819378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:54.822177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 292/582] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:54.823514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.829351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.830997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.836341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:54.866218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.867348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:54.868329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:54.868329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:54.868329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:54.869962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 291/583] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:54.871293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.022837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef380f6-9a99-4e20-94ff-4913b42e4ae1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.040445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.082969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0447e6-5f06-4b7c-8589-773e3e2c7f81 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.083418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.084665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.085239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.086082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.087283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.087858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.090228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.105901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 293/584] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.107162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.153713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.154783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.155437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.156338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.157613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.158366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.160547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.185553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 292/585] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.186996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.242408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.310423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f48063-7a33-47b4-b537-1e5bec5407cd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.362902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf468-e356-4043-b660-87d314c4d4fa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.387834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.388870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.389721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.390229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.391374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.392265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.396071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.419141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.420363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.421038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.421519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.432904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 294/586] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.435015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.435589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.438872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.441265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:55.463299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:55.465348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:55.467273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:55.467273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:55.467273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:55.467273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 293/587] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:55.471477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.619221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45048e88-9086-4e5e-af15-cccc8cc1d909 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.650799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.655414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100bd04-68b4-4d14-adae-3974cc48d942 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.659602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.660457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.665219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.665219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.672545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.674387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:55.691694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:55.693343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:55.694261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:55.694261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:55.694261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:55.696223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 295/588] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:55.697353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.725128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.726652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.727593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.727593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.743539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.746479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:55.771725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:55.772839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:55.773767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:55.781448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 294/589] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:55.783043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.822243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c75b-6d1c-4adb-8035-42f634d34b11 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.860242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.863239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.864148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.864632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.865104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.871219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.871219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.871219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.882123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 296/590] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.883310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.935108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc20e8-715b-4cd0-86e6-9cd6b6fcd7ae None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.937778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.985996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.986864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.987132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.987404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.988529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.988848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.990306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.013652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 295/591] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:56.013652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.049920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69544c56-2c26-4250-a89d-29a9b26060f5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.110951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.112304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.112956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.113699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.115222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:56.115930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.118668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.134428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961f0d3-a0fc-461f-a606-a70d536a268e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.152139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 297/592] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:56.153842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.156887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:56.182885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.183535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.183811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.184083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.193345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.194589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:56.210678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:56.212745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:47:56.215018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:56.216525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 296/593] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:56.217758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.307295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:56.310961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37fb7d-e1ad-4e8b-9667-84c3d348c7b6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.351363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d19054-0541-4e96-a88a-d25983911409 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.352906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.353734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.354232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.354666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.362613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.364861 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:56.377086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:56.378485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:56.380048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:56.386574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 298/594] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:56.387712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.392806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.393456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.393735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.394037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.409637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.411187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:56.430896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:56.431887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:56.432739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:56.432739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:56.432739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:56.437509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 297/595] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:56.438717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.473722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:56.510171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02103ad-0725-49db-8214-b4c65a102d64 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.552047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.553244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.554044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.554757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.555825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:56.556606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.558626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.559155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39dd0-c6e5-489d-bf33-0bb2f052b8c7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.578469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 299/596] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:56.579146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.597775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:56.601124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.601736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.602086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.602320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.603019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:56.608469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.608469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9256-b89e-4d6a-9963-3eaed6097019 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.617941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 298/597] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:56.619199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f11a-9d2c-43ae-9bf4-21192ff69e0b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.619483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f11a-9d2c-43ae-9bf4-21192ff69e0b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.619758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f11a-9d2c-43ae-9bf4-21192ff69e0b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.621146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 299/598] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:56.625717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f11a-9d2c-43ae-9bf4-21192ff69e0b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.698669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab598e-d727-4dbe-89d7-4e30bedc5f59 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.714787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:56.731804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f11a-9d2c-43ae-9bf4-21192ff69e0b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.745246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.745875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.746162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.746438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.747085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:56.747428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.748813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.761050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 300/599] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:56.761902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.773879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.774517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.774797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.775066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.786397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.787867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e2468073-9ee3-48e4-b980-036da9d42494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:56.804796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:56.806726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 300/600] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945dea2-b451-478e-b452-dc1b6f226561 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945dea2-b451-478e-b452-dc1b6f226561 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.808487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945dea2-b451-478e-b452-dc1b6f226561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.827053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7945dea2-b451-478e-b452-dc1b6f226561 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:56.828433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7945dea2-b451-478e-b452-dc1b6f226561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:56.855250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:56.880135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218cbe-2b31-4835-bb4c-dc88a6da504f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.909279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 301/601] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:56.910649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026628d9-0721-490a-b29d-094e8ac8b4cb None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.910933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026628d9-0721-490a-b29d-094e8ac8b4cb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.911205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026628d9-0721-490a-b29d-094e8ac8b4cb None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.912476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 302/602] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:56.913182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026628d9-0721-490a-b29d-094e8ac8b4cb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.928173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.929404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.929972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.930504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/aa49e174aaa14829a0281441a834ef4a/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.954573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=aa49e174aaa14829a0281441a834ef4a, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.957113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.005259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.046670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 301/603] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:56 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/aa49e174aaa14829a0281441a834ef4a/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:57.047980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.054459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026628d9-0721-490a-b29d-094e8ac8b4cb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.140418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.143910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.144947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.145660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.163759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.168252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-36fa5c0f-eea5-4d78-83a2-c7eb138090cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:57.194313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:57.196271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 303/604] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.198331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.199679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.222250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:57.224426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:57.242029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0c14-bc80-4452-a25d-7d291f2655e0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.287109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.301122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.302237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.302739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.303220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.304359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:57.304868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.307423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.313542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 304/605] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:57.314655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.333933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 302/606] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:57.333933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.421248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.485186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212263d-5a31-456b-82cb-41722ba4f0ca None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.505265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274887e9-74d3-443a-87f6-31547de9bc6b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.542063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.543516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.544010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.544757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.546580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:57.547516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.550345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.551946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.552816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.553312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.554135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.567914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:57.574211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:57.575154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:57.575991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:57.576615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 303/607] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:57.578922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 305/608] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:57.581944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.593886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.638192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.698550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65b533-f314-4b04-9047-1254717c0730 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.739111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.740105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.740584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.741058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.751358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.753422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:57.766448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:57.767469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:57.768360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:57.771430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 304/609] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:57.772598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.789474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218f4d9-dfd7-41a8-b290-6eaf9b6d2470 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.830454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.844842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.846628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.850804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.850804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/b3e8ae06eace4634ac1a52ddab162d91/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.872011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=b3e8ae06eace4634ac1a52ddab162d91, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.873654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.932840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fb003-22bf-42e3-93a7-bd8e3974d6cd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.941126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.970468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.971164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.971438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.971697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.978696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 306/610] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:57 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/b3e8ae06eace4634ac1a52ddab162d91/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:57.978920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:57.978920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.979067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.979137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.990744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 305/611] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:57.992149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.163148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9483fd-6968-4f52-b304-d14b4e4e4931 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.182228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8a22a-441a-44df-b0ed-ecaeecc42b37 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.218481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.219396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.219828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.220274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.221199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:58.221678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.224005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.240654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 307/612] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:58.241902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.255285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.256453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.256965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.257457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.276864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:58.283220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:58.284383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:58.285944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:58.286821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.289870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 306/613] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:58.290848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.330931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.364187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23398f-ac16-4c5e-89c9-5a02c5dded6c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.405319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.406314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.406759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.407323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.423857 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.426866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:58.447283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:58.448903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:58.450071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:58.450071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:58.450071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:58.462108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 308/614] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:58.462108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.481823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002871f-050e-4477-b2f3-27f9d92f2ea2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.525645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.526683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.527117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.527555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/0a1bda85ce4a41ed8ec354d40ecbb08a/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.546149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=0a1bda85ce4a41ed8ec354d40ecbb08a, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.547907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.584464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.624329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf06e7-21bb-4552-a5fd-5b3de05fe03e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.634430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 307/615] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:58 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/0a1bda85ce4a41ed8ec354d40ecbb08a/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:58.636440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.675120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.676149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.676615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.677065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.678052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:58.678509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.681234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.692363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 309/616] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:58.699479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.862844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.945230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c48d-096b-42ed-9f51-93c6b65dd72c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.979619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598966bd-87f7-46d2-b3a8-c7f5c14f12a9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.020900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.022537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.023362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.024049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.025405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.026377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.028947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.030863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.031512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.031790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.032092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.043822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.047558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.050714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.050976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 308/617] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.057765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:59.076441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:59.078035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:59.079618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:59.079618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:59.079618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:59.079618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 310/618] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:59.086993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.250189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57420-7b7d-4caf-9ae4-420968716d92 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.301886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.302952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.303428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.303997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.309800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2790-45c9-44b4-8fbb-fef585decca7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.314922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.317284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.319706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:59.331429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:59.335103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:59.336058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 309/619] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:59.342603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.387174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.387802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.388080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.388348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.388998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.389305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.390711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.417364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 311/620] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.423577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.468399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e39fe-27a6-4c70-b5fd-0eb395cfd43b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.506630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.507158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.507436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.507708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.508446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.513901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.513901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.533760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.534054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 310/621] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:59.536607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.606639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.630329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00d029-7ccc-4e20-bad3-f5eebc0048c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.649672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6701d1-362f-42e0-9eb5-c8d4993088e6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.687956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.688603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.688885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.689160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.702365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.704548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.721363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.722053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.722329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.722594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:59.733185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:59.734175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:59.735048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:59.735048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:59.735048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:47:59.735048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 311/622] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:59.738775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.743045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.743167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:59.763843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:59.764913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:59.765884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:47:59.774342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 312/623] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:59.782960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.866704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e694e-83ed-401b-8af7-ff34e43b9bc8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.886256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.909669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.910362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.910652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.910931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.911589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.911892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.913283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.928452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 312/624] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.934961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:00.061385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93423b5-2b99-4612-88f7-00936d2da096 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:00.078761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ed7f-3b7c-4b88-826e-988ceeda743e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:00.083595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:00.115013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:00.119441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.119441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.119441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.119441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:00.119441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:00.119789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:00.119879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:00.120180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.120462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.120738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.128563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:00.130622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2aa39e74-4b62-469c-8ce8-4b2a0893bcd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:00.144284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:00.145273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:00.146177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:00.150469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 313/625] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:00.151792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 313/626] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:00.152004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d541c6-7570-410a-94ea-b81a0aea311e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.152169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d541c6-7570-410a-94ea-b81a0aea311e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.152408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d541c6-7570-410a-94ea-b81a0aea311e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.152826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:00.154197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 314/627] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:00.154942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d541c6-7570-410a-94ea-b81a0aea311e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:00.187269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:00.273373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d541c6-7570-410a-94ea-b81a0aea311e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:00.297533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c641e89-a3e1-4c99-a6a3-44346a30d955 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:00.312504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568b5ed-1b37-4ddd-9e8c-a042b4e72788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:00.313146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568b5ed-1b37-4ddd-9e8c-a042b4e72788 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.313501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568b5ed-1b37-4ddd-9e8c-a042b4e72788 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.313843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568b5ed-1b37-4ddd-9e8c-a042b4e72788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.342239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:00.343023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.343311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.343715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.344777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:00.345089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:00.347111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536fd5-c874-47ec-87da-5f49187ce307 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:00.364510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 314/628] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:00.366193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.366701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.367198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.395508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:00.396918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:00.405679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568b5ed-1b37-4ddd-9e8c-a042b4e72788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:00.407321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568b5ed-1b37-4ddd-9e8c-a042b4e72788 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:00.431146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:00.443739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:00.498287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 315/629] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:00.499173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:00.557739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 315/630] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:00.560662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6832760-0c26-4ec1-adb4-b005f2d10bf9 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.561265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6832760-0c26-4ec1-adb4-b005f2d10bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.561831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6832760-0c26-4ec1-adb4-b005f2d10bf9 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.564192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 316/631] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:00.567244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6832760-0c26-4ec1-adb4-b005f2d10bf9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:00.645415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41b067-625d-4acc-bb01-9d55245addea None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:00.694637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6747f-69e9-4361-a51d-ee49d3d0a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:00.695337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6747f-69e9-4361-a51d-ee49d3d0a27d None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.695626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6747f-69e9-4361-a51d-ee49d3d0a27d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.695900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6747f-69e9-4361-a51d-ee49d3d0a27d None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6738164d722a43c7b32706caef761fbe/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.719537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6832760-0c26-4ec1-adb4-b005f2d10bf9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:00.720939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6747f-69e9-4361-a51d-ee49d3d0a27d None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6738164d722a43c7b32706caef761fbe, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:00.723486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6747f-69e9-4361-a51d-ee49d3d0a27d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:00.756027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:00.765433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:00.766508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.767052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.767548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.780034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:00.781998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:00.793979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 316/632] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:00 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6738164d722a43c7b32706caef761fbe/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:00.798378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:00.799011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:00.800239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:00.812559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:00.813611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:00.814667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:00.814667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:00.814667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:00.819990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 317/633] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:00.826252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:00.847317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:00.850327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:00.858670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.014025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 317/634] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:01.014996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.035044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aedbbe-b414-487e-b831-d28577c3c59f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.112264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.113193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.114264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.114554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.116460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:01.117034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:01.120801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:01.148200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 318/635] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:01.154043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.244597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.294340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057f618-4e30-41af-bc2e-6979bbb90075 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.344589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483692be-612d-48c2-8241-88097a6e7f97 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.365899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.366551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.366760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.367039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.385007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:01.390245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:01.391021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:01.391955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:01.392821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:01.394381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.394574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.395582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.396076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.399551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 318/636] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:01.400435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.405953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:01.410376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:01.420882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:01.422297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:01.423206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:01.425640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 319/637] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:01.426955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.531623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808deada-61e0-4609-9f79-68c66802d8f1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.556147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.559536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfabc8-f7d8-4769-b336-59266c44ab84 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.585520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.586209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.586552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.586761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.602782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:01.607773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:01.609158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 319/638] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:01.610366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.616113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.616747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.617036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.617304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.618033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:01.618336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:01.619835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed916b-4535-44ba-af5e-95d7a48e2f7d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:01.630959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 320/639] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:01.632315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9035-de4c-4935-95ba-6ca7361a9b6d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.632600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9035-de4c-4935-95ba-6ca7361a9b6d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.632873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9035-de4c-4935-95ba-6ca7361a9b6d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.634331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 321/640] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:01.635151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9035-de4c-4935-95ba-6ca7361a9b6d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.726672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.787834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc19e1-1060-4c2d-9f67-6ebe682846cc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.792160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9035-de4c-4935-95ba-6ca7361a9b6d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.827539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.828293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.828572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.828841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.829538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:01.829877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:01.831317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:01.847050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.848182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.848469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.848747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.849150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 320/641] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:01.850658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.854454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:01.854786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:01.856186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b721366-8932-4e41-801c-f182a1705689 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:01.870922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 322/642] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:01.870922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.870922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.870922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.901290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:01.903335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:01.933754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.989736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a892b-ed79-4a77-aa2e-ee586d73342c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.017829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.038195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.038918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.039362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.040302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.041777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 323/643] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:02.042918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.056293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.058546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:02.080853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.082723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:02.083624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:02.083624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:02.083624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:02.086195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 321/644] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:02.087573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.174926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed4270-81bb-42cc-80ad-b54ecd82d7ae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.197916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a29e3-e53e-4043-ba22-1d1c9fee6c6e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.215225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.215945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.216295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.216657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.217549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6384fbfdbff1461594e0e4f877bc8e5e) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.217989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.219609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.230312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 324/645] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/role_assignments?user.id=6384fbfdbff1461594e0e4f877bc8e5e&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:02.231462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.237602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.239170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.239649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.240102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.252947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.255809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:02.272296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.273306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:02.274436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:02.274436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:02.274436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:02.276988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 322/646] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:02.282941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.288119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.314620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.418431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df94c0-fd77-4ed4-8cad-23c161989561 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.481673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.483395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.483931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.484478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.485652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.486480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.489812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ad9c1-3164-4f03-a132-41f934c1d1e9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.493388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.540412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 323/647] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:02.546693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.588537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.590169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.590931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.591451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.592306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.592960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.595368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.621670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 325/648] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:02.629807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.771005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.777029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.808300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53d4a4-f114-429f-b062-29b0c272ffe8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.810076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2fdfd-e19c-404d-b7a9-010acc4bd4ce None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.859195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.859873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.860440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.860798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.870541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.871936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.872157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.873018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.873501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.874414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:02.886728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.889017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:02.890700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 324/649] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:02.891808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.891941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.892060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:02.912660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.915099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 326/650] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:02.916986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.053666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c11c8-4736-4401-a130-b391c0093046 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.089293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dee45c-77dd-46f4-b75d-68ca39fa5607 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.120176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.121827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.122713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.123505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.125195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:03.126060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.127088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.128097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.128442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.128831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.130647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.142060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:03.148219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:03.150696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 325/651] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:03.152481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.155496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.159774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.186347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 327/652] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:03.187395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.274393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1de11-4f21-4005-b86a-31734d02a30b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.316044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.317615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.317922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.318202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.318948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:03.319250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.320722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.346540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 326/653] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:03.347516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.364338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108eada-397e-4fe2-b569-8dec4dcbb360 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.414021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.415050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.415535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.416042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.417299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:03.417878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.419037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.420541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.440623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 328/654] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:03.440623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.473700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f902742-da33-41f7-885c-80d7f93b5afc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.513350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b85a-7b1b-4f5f-95e4-3cb6a93d68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.514000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b85a-7b1b-4f5f-95e4-3cb6a93d68b1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.514283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b85a-7b1b-4f5f-95e4-3cb6a93d68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.514731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b85a-7b1b-4f5f-95e4-3cb6a93d68b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.529003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.577810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb8dcd-8e44-4baf-bd4b-08312c2b4871 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.606740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b85a-7b1b-4f5f-95e4-3cb6a93d68b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.608789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b85a-7b1b-4f5f-95e4-3cb6a93d68b1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.614063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.614680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.614955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.615224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.682572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.698546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.701439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.729211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 327/655] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:03.730930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3967-29fd-47e3-b90b-706060ebb325 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.731268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3967-29fd-47e3-b90b-706060ebb325 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.731612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3967-29fd-47e3-b90b-706060ebb325 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.733167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 328/656] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:03.738305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3967-29fd-47e3-b90b-706060ebb325 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.795808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.857379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 329/657] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:03.858650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.918479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3967-29fd-47e3-b90b-706060ebb325 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.962502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.963138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.963422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.964234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.985626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.989165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.996513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e0ed-84a0-45a6-8fb3-6c5f89d66d7a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-52a569e4-50df-44c7-91b9-0b8bc3dc3cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:04.013471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:04.015326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:04.017828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:04.017828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:04.017828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:04.019461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 329/658] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:04.020868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.021161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.021593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.045132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:04.047248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:04.048153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.048850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.049131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.049460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.060731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.062239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.065288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:04.078306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:04.079621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:04.080630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:04.080630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:04.080630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:04.080630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 330/659] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:04.080630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.095085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.178285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 330/660] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:04.178285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.258843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55316d6-b7c9-4c2b-860c-7aad8b8a9840 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.316214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.318055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.318763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.320126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.338786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.340876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.350627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234792d5-3c52-49e2-a2d2-9384b765ff24 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:04.373594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:04.375187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:04.376583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:04.376583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:04.376583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:04.385427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 331/661] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:04.385427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.407006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.408224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.409091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.409586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.411013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:04.411523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.413744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.431699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 331/662] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:04.433375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.439031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.467411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.519101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa25f8-f6b5-4ff6-aa48-91a10efc76d8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.555928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.556553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.556828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.557111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.557761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:04.558173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.559563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.577071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 332/663] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:04.577071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.586945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d78a-1cf1-4b55-aa89-bfc41c5cb33f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.624612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.625609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.626091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.626367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.627016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:04.627318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.629540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.642061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 332/664] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:04.642913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.692746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ae5ff-bb60-45ea-9b54-3af689af2280 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.709965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.719598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.732440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.733142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.733430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.733810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.743347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.745457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.749423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd570d-cee7-4b62-ab8e-d65168766798 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:04.761891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:04.762932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:48:04.763859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:04.766125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 333/665] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:04.771534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.798191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.798833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.799134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.799414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.811429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:04.816899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:04.818041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 333/666] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:04.819175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.935222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aca8-3fa8-46aa-9271-c7cb381a5480 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.966471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38824825-611c-4d09-ad1a-a73aa8b9e59f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.991532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.992519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.992969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.993403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.005414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.007920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.011200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:05.027035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:05.028563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:05.029772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:05.038186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 334/667] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:05.038186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.038921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.039715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.039902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.040171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.052882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.055378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:05.078153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:05.079824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:05.080938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 334/668] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:05.081692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.111027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.185273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26a91b-6c00-40d5-8ff6-1fc5717da67d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.217669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f72600-adde-41db-8397-1a08c32de3dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.224119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.224742 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.225023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.225299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.226061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:05.226369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.227829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.247953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 335/669] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.249360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.267840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.268527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.268809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.269188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.269962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:05.270475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.272075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.285446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 335/670] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.285446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.347169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.364282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.367360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863fcc2-0bfc-494e-887b-e7982eebebdd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.417509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82520631-10fe-44df-b0b1-16c993266166 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.419654 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.420608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.421059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.421509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.422447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:05.422859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.424554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704848b-9c6a-4438-a3d5-4da9aca1e442 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.439027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 336/671] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.440388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35e0f7-56a9-4f44-8d6e-c80efc73e2fb None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.440691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35e0f7-56a9-4f44-8d6e-c80efc73e2fb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.440952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35e0f7-56a9-4f44-8d6e-c80efc73e2fb None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.442912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 337/672] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:05.443719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35e0f7-56a9-4f44-8d6e-c80efc73e2fb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.471999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.472774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.472918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.473079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.473808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:05.474181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.475688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.489419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 336/673] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.490359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.571920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35e0f7-56a9-4f44-8d6e-c80efc73e2fb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.608107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670da3f7-9cb2-4855-b474-f0634d8ce52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.608710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da3f7-9cb2-4855-b474-f0634d8ce52c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.608987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da3f7-9cb2-4855-b474-f0634d8ce52c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.609267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670da3f7-9cb2-4855-b474-f0634d8ce52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.622089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd69c-1a0b-4e4c-b722-1583bd684b1a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.631385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.641486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.661360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.662543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.663116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.663402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.677061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.678575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.686596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670da3f7-9cb2-4855-b474-f0634d8ce52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.688540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670da3f7-9cb2-4855-b474-f0634d8ce52c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:05.695248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:05.697205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:05.699006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:05.699006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:05.699006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:05.699006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 337/674] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:05.699006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.813881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5fa07-6e11-498c-ba88-a8c966b44544 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.829970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 338/675] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:05.832622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.833135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.833625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.855583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.856196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.856478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.856755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.857486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=b3e8ae06eace4634ac1a52ddab162d91) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:05.857794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.859274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.862884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:05.864925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:05.866751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 338/676] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/role_assignments?user.id=b3e8ae06eace4634ac1a52ddab162d91&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.867606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.913439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.963711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.983716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 339/677] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:05.984894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.047662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781c90-4114-4ea3-9f0d-63c6ec34b7dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.108688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.109592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.110407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.110843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.112532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=aa49e174aaa14829a0281441a834ef4a) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:06.113071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.114531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f5049-c7dc-4ed9-be0b-28400b75ab8b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.115048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.123733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 339/678] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/role_assignments?user.id=aa49e174aaa14829a0281441a834ef4a&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:06.125923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.161644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.162459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.162826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.163305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.164120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:06.164537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.166100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.184856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 340/679] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:06.195823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.274281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:06.275264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:06.301717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e28d2-9798-4106-9ec8-89b12722f06a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.354357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880da15-1461-4efc-b9ac-45ed6da99dd9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.362522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.364103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.365322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.365877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.382287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.385337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.403426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.404239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.404526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.404801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:06.409109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:06.410704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:06.411602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:06.411602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:06.411602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:06.414101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 340/680] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:06.417171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.421959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.422164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:06.451948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:06.453169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:06.454987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:06.456024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 341/681] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:06.463124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.566141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee94dd3-507e-4e2b-92dd-c08056446248 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.601488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ce92b-aff4-478f-a388-8b39c0876f06 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.612297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.613693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.614124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.614498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.615359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:06.615762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.617494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.625202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:06.631197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 341/682] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:06.632580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.632908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:06.657952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.658681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.659061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.659402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.660795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:06.661185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.662783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.688975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 342/683] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:06.688975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.824270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7451e6-3dbc-43c2-ab2f-b9c1a8fd96cb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.847053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778960-165f-4d7b-bc96-3b0e3b65929e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:06.881757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.882934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.883357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.883999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.904756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:06.915127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:06.916951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:06.918640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:06.921368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:06.922501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 342/684] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:06.923362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:06.924104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:06.924271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:06.925202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:06.939270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:06.942487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:06.971756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:06.974181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:06.981724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:06.988897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 343/685] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:06.988897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.038537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:07.040607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:07.123539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e374-c330-41ba-84c4-0a8806b8f441 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:07.131389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915b934-33be-4515-8290-30208ebbb87f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:07.174810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:07.175923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.176561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.177034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.178047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:07.178572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:07.180367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:07.190952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:07.192574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.193043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.193215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 344/686] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:07.193355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.194552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.331156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:07.337842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:07.340067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:07.347193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a944b-f424-4157-8253-c8f08e29399f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:07.394001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:07.395576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.396123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.396617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.397576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:07.398118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:07.399926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:07.415420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 345/687] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:07.417321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.440949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:07.502870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 343/688] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:07.502870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.581280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f36ab-e9b4-450f-a4d4-38b6a519ea8a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:07.625054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae1392-467e-493b-99b4-b4c0115f80a5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:07.647814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:07.649304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.650169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.650864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.666557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:07.667176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.667527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.667804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.669058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=0a1bda85ce4a41ed8ec354d40ecbb08a) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:07.669058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:07.670558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:07.673203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:07.676826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:07.678187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 344/689] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:07 2022] GET /identity/v3/role_assignments?user.id=0a1bda85ce4a41ed8ec354d40ecbb08a&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:07.679131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:07.704731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:07.706608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:07.709137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:07.709137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:07.709137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:07.710266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:07.722304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 346/690] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:07.722304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.730267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:07.809316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0ad1b-a805-43a2-bf21-7e64862356d9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:07.892731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:07.893380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.893666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.893972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.920644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:07.922444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:07.953682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:07.955709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:07.958859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:07.958859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:07.958859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:07.958859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 345/691] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:07.964653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:07.987232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebebcd7-c1ee-42bf-9fbe-5f480cb4367a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.062418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.063866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.064219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.064508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.065184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:08.065495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.067050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.083370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 347/692] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.088678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.145023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.177665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a5275-7d46-4233-8221-2035244a1147 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.220758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.265617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.267293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.268092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.268920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.272055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:08.273266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.276114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.282032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1637e-8d4e-46a1-8805-7fb14203be7f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.302667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 346/693] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.308443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.355164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.355808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.356089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.356362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.368064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.369524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:08.382952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:08.384059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:08.384993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 348/694] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:08.390914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.472151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb83db-a171-40c2-84f8-70dfd6b57b40 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.518195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67dfc-4a3f-4d8d-a875-c1f49d2ced31 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.533782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.535060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.535560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.539032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.546310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.548755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.551913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.560656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.561293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.561576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.561874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.562662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:08.562972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.564566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:08.570169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:08.571161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:08.572042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:08.576247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 347/695] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:08.585419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.591118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 349/696] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.591345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.793051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ffd1-7449-4333-b459-284848cdec7a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.868358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04192d85-267e-44de-a09f-c1ffc7add66e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.875920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111dc5a-be34-477e-a4d3-a6eff4701f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.876554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111dc5a-be34-477e-a4d3-a6eff4701f85 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.876838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111dc5a-be34-477e-a4d3-a6eff4701f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.877114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111dc5a-be34-477e-a4d3-a6eff4701f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.923804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.924706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.925246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.926686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.927582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:08.928034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.929644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d6cb7-c461-4f2d-a98d-9e719d5940aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.946840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 348/697] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.948819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f9855-9610-423f-a5f0-733f69c65e7b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.949256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f9855-9610-423f-a5f0-733f69c65e7b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.949668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f9855-9610-423f-a5f0-733f69c65e7b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.955895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 349/698] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:08.956544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.958893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.959363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.960628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.980046 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111dc5a-be34-477e-a4d3-a6eff4701f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.981553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111dc5a-be34-477e-a4d3-a6eff4701f85 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.982989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:08.984390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:09.054289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:09.085886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 350/699] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:09.085886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.120879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 350/700] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:48:09.122681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f5ba-f8b8-4780-ab5d-309453f25cfa None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.123040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f5ba-f8b8-4780-ab5d-309453f25cfa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.123474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26f5ba-f8b8-4780-ab5d-309453f25cfa None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.125626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 351/701] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:09.129493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26f5ba-f8b8-4780-ab5d-309453f25cfa None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.231596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23db9c-b740-4429-8076-18884c3f212a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:09.287260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:09.289645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.290489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.291910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.294614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6738164d722a43c7b32706caef761fbe) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:09.295319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:09.296652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:09.299908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dd38e-4e67-4887-ab06-a53130752e63 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:09.317238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 351/702] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:09 2022] GET /identity/v3/role_assignments?user.id=6738164d722a43c7b32706caef761fbe&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:09.326601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.326601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.326601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.340587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26f5ba-f8b8-4780-ab5d-309453f25cfa None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:09.368233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:09.371102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:09.403620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:09.404413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.404761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.405039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.419890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:09.421632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:09.436306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:09.445008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:09.446205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:09.447286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:09.447286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:09.447286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:09.454020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 352/703] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:09.455578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.470038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 352/704] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:09.471146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.645922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea76b8-70a7-42c1-912f-75079ea47b34 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:09.690106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c0049-7e4d-4dc8-9d1a-bc782d1c8919 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:09.707565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:09.712207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.712207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.712207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.712207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:09.712207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:09.712207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:09.729740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 353/705] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:09.739124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:09.741370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.747970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:09.754338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.754338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.754338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] PATH_INFO: `/v3/services/network` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.754338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:09.754338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:09.767571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:09.768786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:09.770144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 353/706] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:09 2022] GET /identity/v3/services/network => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:09.776535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.850369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:09.948178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc886-f97d-4ad4-887f-e3217ce4eb71 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:09.987493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397c447-2d0e-4cba-b608-5352883ee48b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:10.011736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.012986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.013603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.014265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.015554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:10.016226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.018992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.028248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 354/707] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:10.029868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:10.072701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.074295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.074579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.074851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.093747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.098588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.126314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:10.130430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:10.131770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:10.133572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:10.134467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 354/708] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:10.135913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:10.165503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77b6a-b900-4246-bc96-e67bf32776b5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:10.244116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.244673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.244955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.245240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.246745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.247501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:10.257779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:10.260003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:10.261938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 355/709] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Oct 10 11:48:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:10.263635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:10.305041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:10.316123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2d9c-c67d-46a4-9617-d024063559c9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:10.388683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.389870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.390475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.391782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.392780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] RBAC: Adding query filter params (type=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:10.393254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.395995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.410378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 355/710] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:10.411743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:10.425102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f41ec2-779c-452c-97f9-805373b3215e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:10.479523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:10.493090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.501987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.501987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.501987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.501987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:10.501987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.501987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.513983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 356/711] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:10.521813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:10.676357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cace0e5-98b8-4fb3-824e-d583050fd9b9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:10.721417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.723575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.724098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.727625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.727625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6384fbfdbff1461594e0e4f877bc8e5e) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:10.727625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.729771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.742382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 357/712] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:10 2022] GET /identity/v3/role_assignments?user.id=6384fbfdbff1461594e0e4f877bc8e5e&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:10.749550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e468b6-44f0-4a89-baad-74a69b65e481 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:10.804798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:10.805422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.805703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.806017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.806662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:10.806964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:10.808393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc4f20-39ea-46cb-9bf3-3d7a266c556c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:10.814032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 356/713] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Oct 10 11:48:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:10.820412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:10.886160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5c7c-4944-41b5-a128-9ba2f89cd360 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.886614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5c7c-4944-41b5-a128-9ba2f89cd360 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.887005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf5c7c-4944-41b5-a128-9ba2f89cd360 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.888935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 357/714] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:10.895252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:10.895567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:10.895883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:10.913508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:10.935016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:10.936272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:10.977733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:10.987081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3250036-955b-49d9-bb85-689f11dae09f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:11.028910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:11.030001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.030507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.031176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.032193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:11.032708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:11.033492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 358/715] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:48:11.035462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:11.042185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 358/716] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Oct 10 11:48:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:11.508700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:11.734632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5272f8-a8f2-4084-8f2b-d86fa2437832 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:11.822296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:11.824025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.824763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.825532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.854423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:11.857680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:11.893105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:11.895606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:11.897366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:11.897366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:11.897366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:11.901001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 359/717] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:11.908261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:12.073886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c7cc-3756-4e8a-a911-dc74f486721f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:12.094352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:12.124631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:12.125274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:12.125557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:12.125834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:12.126549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:12.126858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:12.129256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540518e-7c73-4589-bbee-c27ec3667343 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:12.147179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 359/718] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:12.155265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:12.177689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:12.321535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9f311-b2b8-4136-a589-c77d4ce716a4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:12.349234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f269d-c6de-4d66-8741-a154d2eedfca None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:12.349410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f269d-c6de-4d66-8741-a154d2eedfca None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:12.349696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f269d-c6de-4d66-8741-a154d2eedfca None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:12.352525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 360/719] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:12.357018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:12.357307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:12.357589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:12.382727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:12.384014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:12.399396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:12.400543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:12.401557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:12.402115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:12.403376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:12.405572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:12.506065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 361/720] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:48:12.515963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 360/721] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:48:12 2022] POST /identity/v3/users => generated 254 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:12.892258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:13.036055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be183194-53e5-497e-83cd-a6b78daaf3a1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:13.037664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:13.074070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:13.074719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:13.074995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:13.075265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:13.087535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:13.092351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:13.093350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:13.094254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 362/722] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:13.101132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:13.210539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:13.265444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb5d73-b7fc-47ed-8e5d-4243b90ca121 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:13.319360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:13.319984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:13.320264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:13.320538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:13.321208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:13.321515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:13.322946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:13.339146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 361/723] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:13.345920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:13.607795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd91e4-a1ac-4bb7-bef3-093fc6e40270 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:13.672904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:13.673552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:13.673837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:13.674142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:13.695005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:13.696507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c2d06702-3b18-4bc9-a20e-8d9ec59667f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:13.723639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:13.724599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:13.725456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:13.725456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:13.725456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:13.725456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 363/724] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:13.734260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:13.867162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880a3c-a9cc-425b-a7df-306f26fc4f28 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:13.867415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880a3c-a9cc-425b-a7df-306f26fc4f28 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:13.867718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880a3c-a9cc-425b-a7df-306f26fc4f28 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:13.869317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 364/725] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:13.881556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:13.881832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:13.882198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:13.952123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:13.955461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:13.964522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e942bf-90fc-4ed8-948c-e8ef4fcd4474 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:13.978584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.053739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.093161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.094444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.094588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 365/726] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:48:14.095020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.095562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.096755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:14.097506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.102848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eae575-bb16-4f6d-885e-5c66255dd728 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:14.123260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 362/727] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:14.129780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.159088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e971a-0847-4f9b-b178-5796891c98a2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.159351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e971a-0847-4f9b-b178-5796891c98a2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.160230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e971a-0847-4f9b-b178-5796891c98a2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.163476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 363/728] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:14.173169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.173603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.173952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.217381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:14.220595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:14.394810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 364/729] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:48:14.395623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.412657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fe122-b819-46e8-b143-36d64ba2947d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.494070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.495706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.495988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.496264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.515798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.518128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:14.545249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:14.547125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:14.549057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 366/730] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:14.558370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.568939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.615833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a28ec5-2987-4d82-aa4b-119a02dc5e79 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.653105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.681865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35cc54-9604-4a79-af53-20696bee8dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.682520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35cc54-9604-4a79-af53-20696bee8dad None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.682995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35cc54-9604-4a79-af53-20696bee8dad None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.683274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35cc54-9604-4a79-af53-20696bee8dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.706811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35cc54-9604-4a79-af53-20696bee8dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5a35cc54-9604-4a79-af53-20696bee8dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:14.715905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:14.717740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:14.719440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:14.724251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 365/731] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:14.726382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050461f8-f65f-4761-8c7a-d62ba609c4d5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.727266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050461f8-f65f-4761-8c7a-d62ba609c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.728077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050461f8-f65f-4761-8c7a-d62ba609c4d5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.735811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 366/732] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:14.737333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050461f8-f65f-4761-8c7a-d62ba609c4d5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.778016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86371b-6aa3-4d22-8b72-f675b5fe8262 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.818135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.818754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.819036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.819317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.820054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:14.820360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.821814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:14.840945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 367/733] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:14.846468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.890197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050461f8-f65f-4761-8c7a-d62ba609c4d5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.924539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.939110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.940031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.941550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.942214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.943560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:14.944091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.946547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1d8f4-a247-4a54-bb7a-051476200cd7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:14.959544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 367/734] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:14.961182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.961518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.961799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.976455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa684-03f2-4e84-9edc-b0125ff19aae None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.984161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:14.986216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:15.017795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.018443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.018726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.019045 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.019708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.021217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.035946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.078716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 368/735] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:48:15.080070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.122670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 368/736] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:14 2022] POST /identity/v3/services => generated 240 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:15.123441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.308915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05d1d5-c672-4ad1-8ac3-785205af5924 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:15.407567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d993d-b44a-422d-89af-048f6426b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.409404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d993d-b44a-422d-89af-048f6426b45f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.410220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d993d-b44a-422d-89af-048f6426b45f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.411035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d993d-b44a-422d-89af-048f6426b45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.431626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06b244-0859-478a-a8f7-a11e3b7aa5fd None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:15.478952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.502508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.539815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.540849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.541324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.541792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.560439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d993d-b44a-422d-89af-048f6426b45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.560696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.561188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d993d-b44a-422d-89af-048f6426b45f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.563600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:15.584420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:15.585594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:15.587376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:15.587376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:15.587376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:15.587376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 369/737] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:15.587376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.708957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 369/738] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:15 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:48:15.712137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b7a7-cfee-4f17-a5f2-2b051226f901 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.712137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b7a7-cfee-4f17-a5f2-2b051226f901 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.712951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b7a7-cfee-4f17-a5f2-2b051226f901 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.717905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 370/739] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:15.717905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b7a7-cfee-4f17-a5f2-2b051226f901 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.746131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0566068-299c-414b-8004-eb255ecb69dc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:15.789309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.790061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.790346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.790616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.791281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.792691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.809674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.855499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b7a7-cfee-4f17-a5f2-2b051226f901 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:15.857960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 370/740] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:15 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:15.858624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.923388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.924053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.927214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.927777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.928226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.929072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:15.929556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.931185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80a905-293b-4f74-a73a-5103f0f348f4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.950287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 371/741] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:15.952320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.953580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.954117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.984896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:15.986648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:16.039064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30023b46-d0aa-41fd-8636-d726e74d9cee None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.089723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.090415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.090700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.090976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.095762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 372/742] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:16.096759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.111439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:16.113518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:16.132618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:16.134103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:16.135692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:16.135692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:16.135692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:16.135692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 371/743] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:16.140124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.187296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:16.286188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd404a6a-66d3-4724-a78d-d9cf94da2108 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.328283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:16.364013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1bad-d299-4f3b-b5de-b6c362cc697e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.376779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.378161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.378704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.379192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.395936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:16.397642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:16.427591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:16.428601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:16.429527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:16.436363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 373/744] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:16.468634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.491332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.492004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.492482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.493060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.494146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:16.494692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:16.497376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:16.519805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 372/745] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:16.521100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.590693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b4314-75fb-416b-a69d-3238e8c8541c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.603067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:16.631147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.631831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.632264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.632642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.633628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:16.634099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:16.635658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:16.647080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9370c-db62-4682-9540-7592754acf8b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.661709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 374/746] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:16.662849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.685746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.686429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.686712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.686986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.705517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:16.711165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:16.715575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:16.717108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:16.718807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 373/747] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:16.718973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.732714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:16.797229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9b080-6d75-440a-9b42-0586d6d4b7b5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.851329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.852696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.853089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.853464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.862320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:16.864668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:16.882038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:16.883526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 375/748] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:16.885693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:16.887016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd3a53-aede-450f-9ecd-358bf3b266fb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:16.937646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:16.938331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:16.938645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:16.939440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:16.944441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:16.954090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:16.955797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:16.974316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:16.976916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:16.979134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:16.979134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:16.979134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:16.979134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 374/749] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:16.979134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.053746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.089842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ea24f-119f-4c07-94bf-a3018d2f171d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.109392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0abd26-6204-4662-8f71-595da357cc20 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.135803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.136376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.136697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.136979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.137683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:17.138052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.139563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.149788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 376/750] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.150788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.158309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.160564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.160854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.161134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.161907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:17.162229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.163801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.183656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 375/751] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.184832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.308249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.314910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c778-5094-4f78-8ef7-61c678b8e0ed None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.326222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e230c-c973-44a0-a46e-720b5fc3fdfc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.337114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.357429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.358456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.358885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.359418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.372112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.374104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.393065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:17.394379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:17.395492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:17.396520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:17.396520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:17.396520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:17.396696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.396696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.396696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.396885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:17.397321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.402980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.403491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 376/752] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:17.404670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.430059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 377/753] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.431648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.521043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373645-ae98-423b-a747-79dc8e7f71a6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.559140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.559808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.560106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.560442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.561090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6738164d722a43c7b32706caef761fbe) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:17.561399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.562876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.574215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 377/754] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/role_assignments?user.id=6738164d722a43c7b32706caef761fbe&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.575222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.647027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629a750-7958-4287-9b95-1a08f3f398ab None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.666369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.747140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.748525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.749208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.749927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.751499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:17.751956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.754923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b5369-9e4c-4f81-a047-c26bb89a78d4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.761495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962539d-8fee-4d7b-b3ed-a3136bca58e5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.776304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 378/755] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.778151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283889f-38f9-4ac6-ad1b-a5e3219f53e6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.778676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283889f-38f9-4ac6-ad1b-a5e3219f53e6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.779188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283889f-38f9-4ac6-ad1b-a5e3219f53e6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.781197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 379/756] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:17.782411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283889f-38f9-4ac6-ad1b-a5e3219f53e6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.804416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.830494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.831687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.832211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.832845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.842024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.844067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1d1bc2ba-2b46-4507-827b-b6632fac46de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:17.860142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:17.861109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:17.862024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:17.865187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 378/757] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:17.866796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.867298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.867889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.890040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:17.891258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:17.954548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283889f-38f9-4ac6-ad1b-a5e3219f53e6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.001051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 379/758] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:18.002866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.023617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.025243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.026024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.026757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.043122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.046462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.048659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:18.070874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:18.072683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:18.074543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:18.079952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 380/759] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:18.089155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.200120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892811-a57a-4f2f-89b7-8be0872cd398 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.236249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.276838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.277420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.277769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.278074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.278891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:18.279090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.280783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.291161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c3ce-4539-4356-bb5c-1f94c095294c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.297824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 380/760] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:18.306988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.338865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.340090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.340381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.340656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.341393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:18.341700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.343628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.364890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 381/761] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:18.366163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.424377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.442096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0dd18-8940-4228-8dfa-95482d81035b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.481698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf991f9d-6f0f-4c7e-910e-a8a9e9c8c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.482405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf991f9d-6f0f-4c7e-910e-a8a9e9c8c445 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.482718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf991f9d-6f0f-4c7e-910e-a8a9e9c8c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.482954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf991f9d-6f0f-4c7e-910e-a8a9e9c8c445 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6384fbfdbff1461594e0e4f877bc8e5e/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.484900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf991f9d-6f0f-4c7e-910e-a8a9e9c8c445 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6384fbfdbff1461594e0e4f877bc8e5e, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.486536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf991f9d-6f0f-4c7e-910e-a8a9e9c8c445 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.499894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14e683-78cb-4c3a-a056-e079512ba94e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.528826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.537089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.537728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.538033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.538304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] PATH_INFO: `/v3/services/network` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.538887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.540240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:18.551552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:18.552730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:18.553965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 382/762] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:18.554758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.571659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 381/763] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:18 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6384fbfdbff1461594e0e4f877bc8e5e/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:18.573369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d198c4-3a8d-465c-87b9-811ab39d41f0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.579848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d198c4-3a8d-465c-87b9-811ab39d41f0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.579848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d198c4-3a8d-465c-87b9-811ab39d41f0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.579848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 382/764] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:18.579848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d198c4-3a8d-465c-87b9-811ab39d41f0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.690213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ec58-f7f9-48c8-8949-ad316e919991 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.733710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.734405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.734687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.734960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.742240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d198c4-3a8d-465c-87b9-811ab39d41f0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.795459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.796895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.796895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.796895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.797243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:18.797543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.799756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d8b3-051a-4a9d-a3cb-bfe3a02959e2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.810023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 383/765] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:18.812676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.813207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.813969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.818054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.829661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.832277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.843008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:18.844308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:18.848001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.933155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 384/766] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:18.934483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.969352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 383/767] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:18.971488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.122901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8d05-5516-453c-8348-b020f0ee2666 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.124790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:19.165766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.166447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.169005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.169005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.179515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.180974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.181924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fe754-02f1-42ed-98f5-fc4c479acd1c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:19.198360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:19.199550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:19.200599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:19.200599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:19.200599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:19.200599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 384/768] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:19.205883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.314573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.315840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.316121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.316398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.316632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a36e7-980a-4216-8802-f543dfe26a73 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.317042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] RBAC: Adding query filter params (type=network) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:19.317349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.318756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.324414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 385/769] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:19.325406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.328131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:19.356366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.357533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.358370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.359105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.360012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:19.360516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.362146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.385768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 385/770] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:19.387311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.392942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:19.447203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661211b-05e4-4286-a830-6763e5ffd114 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.495212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.495874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.496151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.496423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.497009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.498618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:19.509056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:19.510168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:19.512053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 386/771] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:19.512822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.566165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab05107-24f5-4176-8bfd-79239d6ff746 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.612711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:19.613625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.614439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.616291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.616754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.617644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] RBAC: Adding query filter params (interface=public, service_id=269b3c320dbf487aa0ff222f3edb9f5e, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:19.618482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.620176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.641504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 386/772] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/endpoints?service_id=269b3c320dbf487aa0ff222f3edb9f5e&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:19.641504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.682421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f25b14-e4bc-4734-99a1-7bf3e7709e37 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.734290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.735462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.735895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.736314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.745488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.747557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.748747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:19.763882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:19.764983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:19.766030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:19.768131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 387/773] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:19.769727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.823929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8f5f6-5fb3-4c56-a068-000d57d3d889 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.885160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.886057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.886456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.886826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.887564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:19.887962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.889503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.895986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 387/774] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:19.897116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:19.905547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188b5b7-b47a-4008-bf60-e9362356dc47 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:19.948466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:19.962095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:19.963439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:19.963895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:19.964324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:19.965202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:19.970706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:19.981168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 388/775] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:19.982967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.103688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117432d-8db6-4c4c-b260-92f98122e45b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.163738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:20.170288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.170919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.171197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.171471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.172458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:20.180197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.180197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404a031-4acd-43ab-bc2d-5bbaf39afa70 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.187863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858ee92-9b97-44fb-a878-6c30bc174b78 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.196242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 388/776] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:20.196242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c093-0103-472d-8366-83b999b317d7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.196242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c093-0103-472d-8366-83b999b317d7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.196242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c093-0103-472d-8366-83b999b317d7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.197493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 389/777] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:20.198960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.199238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.199513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.223804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:20.225034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:20.257176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.258089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.258910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.259202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.260281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:20.260410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.262556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.269760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 389/778] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Oct 10 11:48:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:20.270627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.327323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 390/779] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:20.328912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.365954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:20.461776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa07d5-88c8-4b4f-aafb-5be6409c3c9e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.489444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac4eb6-a12d-4ecf-b5f0-e0e4291a921f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.516630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:20.535195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.535844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.536127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.538559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.539718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] RBAC: Adding query filter params (interface=public, service_id=c8bc528133564bc2a1138d8e72a4841e, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:20.540107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.541595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.547034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.547662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.547943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.548220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.549027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=866d752ffa524c449a285cf975b21d07) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:20.549343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.550857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.557384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 390/780] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:20 2022] GET /identity/v3/role_assignments?user.id=866d752ffa524c449a285cf975b21d07&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:20.570835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 391/781] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:20 2022] GET /identity/v3/endpoints?service_id=c8bc528133564bc2a1138d8e72a4841e&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:20.576851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.697655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.785385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085da0d7-3e5a-4715-9f63-0c488eee99b9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.819221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:20.853411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.854063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.854340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.854727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.855339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.856826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.870055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 391/782] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:20 2022] GET /identity/v3/services => generated 772 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:20.885911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c4c04-55e4-4efa-af61-ae9170851436 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.949355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ed7b7-d632-4950-84ba-19e89834caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.950258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ed7b7-d632-4950-84ba-19e89834caf1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.951045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ed7b7-d632-4950-84ba-19e89834caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.951546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ed7b7-d632-4950-84ba-19e89834caf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.972963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ed7b7-d632-4950-84ba-19e89834caf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-570ed7b7-d632-4950-84ba-19e89834caf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:20.982993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:20.983990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:20.984844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:20.985581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 392/783] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:20.991354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:21.170791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3de5a0-0a10-4899-809b-662d54fd3a85 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:21.170791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3de5a0-0a10-4899-809b-662d54fd3a85 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:21.170791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3de5a0-0a10-4899-809b-662d54fd3a85 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:21.170791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 393/784] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:21.183091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58484b-25f6-40fd-a3bd-2fc7e66ee37b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:21.183655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:21.184150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:21.184682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:21.213236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:21.214911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:21.241890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:21.242712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:21.243185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:21.243666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:21.244885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:21.245133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:21.246767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:21.263664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 392/785] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:21.272241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:21.284954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:21.337897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 394/786] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:21.360526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:21.465353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df9e93-778e-46be-b67d-8433b9ee4900 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:21.521967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:21.522928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:21.523412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:21.523860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:21.542344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:21.544145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:21.566788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:21.567791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:21.568668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:21.568668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:21.568668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:21.570325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 393/787] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:21.576834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:21.668327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:21.741892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b6b1-13a1-43ce-b4fc-a3b0cc3e9f7e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:21.821355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:21.822314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:21.822613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:21.823029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:21.824104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:21.824414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:21.826006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:21.849928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 395/788] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:21.863035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:21.864672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:21.869258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea161ab-9a4e-459e-a180-634b0b743be8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:21.907972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:21.908620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:21.908902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:21.909176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:21.934782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:21.936879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:21.941130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:21.942234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:21.943050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:21.946765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 394/789] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:21.952528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:22.095484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e03cd-a816-4b3c-9a54-077146bf60a0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:22.169014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:22.169923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:22.170281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:22.170559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:22.183288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:22.184778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:22.195870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3500c0d-de11-493e-95c8-c9fb70a3a863 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:22.209151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:22.210173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:22.211104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 396/790] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:22.218901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:22.233269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:22.233937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:22.234223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:22.234501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:22.235382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:22.235747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:22.237439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:22.247610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 395/791] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:22.254329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:22.299719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:22.445329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:22.462513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954d30b-e19d-49b6-ba7e-062fc0ada2de None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:22.472066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1937-a891-4eff-b655-d06d2323d736 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:22.519066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:22.520169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:22.520791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:22.521286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:22.534069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:22.537102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:22.554424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:22.555407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:22.556289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:22.556289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:22.556289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:22.558368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 396/792] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:22.562536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:22.563237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:22.563553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:22.563830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:22.564316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:22.564626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:22.564936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:22.566951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:22.609797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 397/793] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Oct 10 11:48:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:22.616054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:22.686913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:22.766103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd5c3b-abec-4171-bcef-cc3d938b52ab None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:22.814224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:22.815125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:22.816146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:22.816575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:22.817409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:22.817888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:22.819466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:22.835000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 397/794] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:22.841469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:22.923962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8522886-049c-40bd-ac60-1c1aa6291937 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:22.988046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:22.990038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:22.990536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:22.991028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:22.996633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5112d71-a8fa-4e6a-88f6-d0180be939ed None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.014582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.016051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-53749000-55c8-40e6-b717-17ad5ece44d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:23.033026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:23.034049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:23.035537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:23.035537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:23.035537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:23.036452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.038048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 398/795] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:23.039491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ba8e-83d9-4e6c-b94a-3ecb34986102 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.039986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ba8e-83d9-4e6c-b94a-3ecb34986102 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.040610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185ba8e-83d9-4e6c-b94a-3ecb34986102 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.042514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 399/796] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:23.043756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.050098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.050098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.050098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.050356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.050356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.050356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.054839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.056579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.064559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.071562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:23.072182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:23.073141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:23.074171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:23.074702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:23.078219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 398/797] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:23.079278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.165255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 400/798] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:23.166632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.238372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad7d27-7814-42a9-89fc-b28af0e37836 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.289068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a715c-e24f-4761-adc8-8ed2e876be05 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.306691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.307299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.307817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.308247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.309159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:23.309614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.311164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.327936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.328634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.328981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.329323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.330160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:23.330538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.332083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.335010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.340475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 399/799] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:23.346000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.353760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 401/800] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:23.365905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.434651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.511636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40861966-57c6-4142-8d7a-0d994ba59c92 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.513538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc2c9-5fd6-4431-8c1b-bf54129f7d61 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.554262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.554904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.555201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.555460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.628921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.637385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.638962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.670623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.671283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.671562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.671840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.678874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.680344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-acdd13f6-cb2b-406a-b5ce-f24e89c7d1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:23.692192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:23.693122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:23.694036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:23.698144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 400/801] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:23.699521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3763fc-9bb0-4f7e-950e-1794d9325208 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.699902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3763fc-9bb0-4f7e-950e-1794d9325208 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.700024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3763fc-9bb0-4f7e-950e-1794d9325208 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.701887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 401/802] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:23.702014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3763fc-9bb0-4f7e-950e-1794d9325208 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.766302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 402/803] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:23.767395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.820564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3763fc-9bb0-4f7e-950e-1794d9325208 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.832349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.855718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.856438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.856719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.856988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] PATH_INFO: `/v3/services/network` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.857569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.858969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.866488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2fb0beae-75f3-4825-bcf6-9c3ff0c6e319 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:23.868362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:23.869332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:23.870276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 402/804] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:23.871132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af0ea1-ca8f-4452-abf0-34a148d864f3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.871132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af0ea1-ca8f-4452-abf0-34a148d864f3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.871260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af0ea1-ca8f-4452-abf0-34a148d864f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.878591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae36ee-e409-4972-aab7-b8526fdaf9e9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.890096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-20af0ea1-ca8f-4452-abf0-34a148d864f3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:23.891341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-20af0ea1-ca8f-4452-abf0-34a148d864f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:23.915034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.915637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.915911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.916182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.916867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:23.917169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.918628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.930273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 403/805] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:23.931236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.963531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 403/806] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:23.965238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080907-d2cf-46b9-bfed-d1c5da180653 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.965522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080907-d2cf-46b9-bfed-d1c5da180653 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.965792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080907-d2cf-46b9-bfed-d1c5da180653 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.967062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 404/807] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:23.967758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c080907-d2cf-46b9-bfed-d1c5da180653 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.054746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc600bf-56a4-477f-9889-6603d3c5ac8a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.077000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c080907-d2cf-46b9-bfed-d1c5da180653 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.080243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.091916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.092785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.093643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.094239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.108650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.110222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.115404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.116060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.116299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.116572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.117207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] RBAC: Adding query filter params (name=network) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:24.117678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.119122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.129314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 405/808] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:24.129314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bce20c85-e04c-40ec-a8a7-3f6a17222689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:24.129561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:24.130684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 404/809] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.144468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.150054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:24.151304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:24.223663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 405/810] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:24.224766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.241018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e4300-d5ee-4ddd-b3ef-672f4e6ac98d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.280748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.281414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.281722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.282026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6738164d722a43c7b32706caef761fbe/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.283997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6738164d722a43c7b32706caef761fbe, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.286050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.342247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130328-2917-4529-b8f2-419b9c43019a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.359111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 406/811] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:24 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6738164d722a43c7b32706caef761fbe/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:24.360134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.394375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.395530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.396044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.396269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.397211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.398276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] RBAC: Adding query filter params (type=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:24.398854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.400579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.411504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.412394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 406/812] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:24.413612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.489131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43ce73-5147-4c57-a42f-1992e4336449 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.538722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.539813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.539813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.540089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.540636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:24.541078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.542606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.555898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 407/813] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:24.561888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.582629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b6359-0b13-4fa0-b74c-5fcda27e3d2a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.622264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56778-538b-40ec-867f-238587856873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.622853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56778-538b-40ec-867f-238587856873 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.623134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56778-538b-40ec-867f-238587856873 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.623408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56778-538b-40ec-867f-238587856873 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.635492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a56778-538b-40ec-867f-238587856873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a4a56778-538b-40ec-867f-238587856873 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:24.641460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:24.642447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:24.643305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 407/814] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:24.644664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56778-538b-40ec-867f-238587856873 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.674535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.687072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340980e0-ce0b-4609-bdb4-0116dc43c894 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.712641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.721462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.722149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.722437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.722715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.723391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.724934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.757793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56778-538b-40ec-867f-238587856873 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.794573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.795231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.795509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.795781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.796378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.797784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:24.807514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:24.810234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:24.811146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 408/815] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:24.811964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.841039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 408/816] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:24.842008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.949973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677c94-5eb5-4b33-8f1c-6edd66c815de None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.982315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:25.004544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.005211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.005487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.005757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.017057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.019181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.030083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613fb1d-a200-4868-98af-e32b118c3635 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:25.033116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:25.034288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:25.035421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:25.037387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 409/817] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:25.038221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.087542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.088362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.088619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.088727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.089391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:25.089695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.091155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.105757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 409/818] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:25.106839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.122691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:25.194597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e9ad4-c0df-4182-9dde-16a85aeca01f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.239140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6209a4-8dd6-4df5-a070-c678cd7a5f5d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.239409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.239703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.239980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.240254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.240954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:25.241453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.243891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.254769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 410/819] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:25.254769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.276799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.277548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.277959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.278335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.279133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:25.279520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.280967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.296570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 410/820] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:25.304106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.318934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:25.386302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d511-9efa-449a-9b12-9e7343808329 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.399157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:25.430750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.431653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.432079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.432652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.444091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09aded-4713-426d-8813-6e2370923301 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.446475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.450440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:25.474389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:25.475421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:25.476316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:25.476316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:25.476316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:25.478165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 411/821] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:25.479033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.495934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.496544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.496782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.497056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.497875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:25.498053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.499319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.505999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 411/822] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:25.512207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.594362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:25.600803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c6a9-3e9d-4778-85cc-f698315b11e4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.641675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.642373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.642597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.642870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.643643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6384fbfdbff1461594e0e4f877bc8e5e) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:25.643950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.645390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.651860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 412/823] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/role_assignments?user.id=6384fbfdbff1461594e0e4f877bc8e5e&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:25.652635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.672804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc704-7a98-4d65-9c9f-42ccb63db905 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.730124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:25.735459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.736230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.736619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.736947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.738342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:25.738719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.741270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.755885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 412/824] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:25.761301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:25.835888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf22c2-1b22-4e42-a331-dfd7f7c7af84 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.890394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.891172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.891548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.891918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.892693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.895584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.915840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be492-800a-4e70-bc79-489ac8d03bbe None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:25.961056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:25.961712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:25.962025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:25.962295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:25.973943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:25.973943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:25.974806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 413/825] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:25.986946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:25.988547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:25.989784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 413/826] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:25.995390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:26.029689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:26.169091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f11512-efa9-4749-91b3-fe2ac4ae517b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:26.209308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:26.210668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.210668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.210668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.211218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:26.211522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:26.212963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:26.241034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 414/827] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Oct 10 11:48:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:26.246818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:26.304146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:26.374481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f719927-4f6b-495d-9fc0-217ab3ede444 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:26.424512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:26.425763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.426138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.426413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.441655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:26.443427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:26.461527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:26.462592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:26.463566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:26.463566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:26.463566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:26.463566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 414/828] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:26.471507 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:26.553713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:26.591938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5e015-31a3-461f-afa6-3013db6b0436 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:26.634029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:26.635031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.635505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.635979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.636820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:26.637315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:26.638915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecfb22-5a59-466f-b104-0ece482a3524 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:26.652708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 415/829] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:26.661675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:26.714997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd7125-f6ff-4ee4-85a2-9dda29328f27 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.715276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd7125-f6ff-4ee4-85a2-9dda29328f27 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.715629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd7125-f6ff-4ee4-85a2-9dda29328f27 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.717624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 416/830] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:26.723165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.723586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.723744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.744941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:26.747283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:26.814018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc73aa-f1d9-4152-aebe-c95385e87224 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:26.817334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:26.847679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 417/831] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:26.872090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:26.872873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.873156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.873436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.882687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:26.884520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:26.899705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:26.900652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:26.901524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 415/832] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:26.908249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:26.975205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.035761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bb6c4-0555-4285-b2ec-497d78d6384a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.099171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.100127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.100583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.101079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.102445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:27.102992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.105659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.125428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 418/833] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:27.132007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.160772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.267102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bc45-a7ce-4f43-a65a-bbd416ab26c3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.310007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.310755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.311032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.311308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/866d752ffa524c449a285cf975b21d07/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.330999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc43a1-5df9-40aa-97bd-78d3544c3838 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.338776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=866d752ffa524c449a285cf975b21d07, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.341471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.361957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.370944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.371622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.371863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.372123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.384212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:27.389013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:27.394900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:27.396188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 419/834] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:27.398620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.430741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 416/835] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:27 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/866d752ffa524c449a285cf975b21d07/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:27.558183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4ebe0-780d-46fc-bc1a-0e8701d93972 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.598087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.599059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.599515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.599962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.600822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:27.601316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.602939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.613575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 420/836] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:27.623773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.651689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.824922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c61df-fed7-46a4-b913-e7f6520f8d3d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.890182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.891182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.891682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.892182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.912168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.914400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-effe1c21-4e2c-435e-82f2-ad3815c140d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:27.943571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:27.944548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:27.945417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:27.945417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:27.945417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:27.946034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 417/837] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:27.955335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.024946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:28.094665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f37a0-7bfc-4058-813f-2c73e5ce2ba5 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.094983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f37a0-7bfc-4058-813f-2c73e5ce2ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.095193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f37a0-7bfc-4058-813f-2c73e5ce2ba5 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.097895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 418/838] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:28.102837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce509-b5c1-4fc6-9b3b-5118f2377989 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.103435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce509-b5c1-4fc6-9b3b-5118f2377989 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.103833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ce509-b5c1-4fc6-9b3b-5118f2377989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.126298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-208ce509-b5c1-4fc6-9b3b-5118f2377989 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:28.127535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a3b54-3d64-4509-98f9-a6ed7c37d371 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:28.128661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-208ce509-b5c1-4fc6-9b3b-5118f2377989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:28.178604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:28.179340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.179722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.180118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.181185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:28.181598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:28.183348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:28.202577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 421/839] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:28.205654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.220523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:28.241066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 419/840] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:28.340186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4b52-e556-4ab4-a287-f6b47cea8d14 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:28.342020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:28.371726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18149-ba2f-4c3e-9654-9fce2672fff6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.372059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18149-ba2f-4c3e-9654-9fce2672fff6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.372285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18149-ba2f-4c3e-9654-9fce2672fff6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.373996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 420/841] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:28.379611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:28.380262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.380372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.380563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.380659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.380802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.380892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.390489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:28.391977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:28.400894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:28.402143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:28.407546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:28.408563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:28.410273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 422/842] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:28.414787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.514062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 421/843] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:28.546551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.571930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81db096-0ce3-4bdc-9de9-64d2f7c9e276 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:28.629825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:28.630755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.631054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.631468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.632564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:28.633134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:28.635045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:28.675710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 423/844] 10.222.0.47 () {56 vars in 1135 bytes} [Mon Oct 10 11:48:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:28.676882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.692263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5c5eb-4364-44d4-8d4c-5be2981d9dd8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:28.719343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:28.729406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:28.745864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:28.746513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.746797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.748157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.748157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:28.749878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:28.762280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:28.763291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:28.764280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:28.770061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 422/845] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Oct 10 11:48:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:28.773229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.819642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec94b0-8064-4cea-be3f-cc31eb1e2339 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:28.858911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:28.859522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.859805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.860074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.913723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c4f0d-7375-444d-90cb-4a27a2cf11f2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:28.948003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:28.949527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:28.955868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:28.957027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:28.957311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:28.957583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:28.958256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:28.958559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:28.959965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:28.970300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 423/846] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:28.971215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:28.980210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.044602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.106340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 424/847] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 11:48:29.106340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.112055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743eec5b-0473-45ad-b7d6-f60831af697d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.155902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.156537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.156816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.157097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.157996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.159583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:29.169244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:29.171187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:29.172039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 424/848] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:29.172857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.236756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fedabc-86ff-4e3c-bc68-e7534f8c890f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.261783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.287628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.288717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.289213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.289707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.290983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:29.291432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.293899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.302542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 425/849] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:29.304027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.332222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f465-3218-4f72-affe-b68997f179aa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.357114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.383920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.385127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.385422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.385901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.405659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.407255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:29.424090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:29.425782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:29.426939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:29.426939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:29.426939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:29.426939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 425/850] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:29.432656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.472058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927f289-de93-4af3-8029-c4a482353452 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.523670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.524890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.525189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.525467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.526173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:29.526481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.528190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.534845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 426/851] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:29.540616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.581604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581f38f-1014-4955-bf42-4ed27558b044 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.611165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.637029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.637664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.638041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.638382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.639048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:29.639355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.640768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.655031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 426/852] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:29.660732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.692363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3011ad-fbf9-4e9f-b6c8-f5c2aa6acabe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.696612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.739170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.739928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.740205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.740479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.741118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:29.741420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.742821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.749785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 427/853] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:29.799440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547a0ec-d3bd-4ec1-8753-24f752df3e0d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:29.842580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:29.843291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.843568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.843887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.852824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:29.854334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-9d1bdd72-ccf7-4fa0-9bbf-a8dde2fd17fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:29.867797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:29.868785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:29.869656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 427/854] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:29.876663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:29.915570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cd5b9-4a62-4bb3-9fd6-420733ecee77 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.916106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cd5b9-4a62-4bb3-9fd6-420733ecee77 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.916194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cd5b9-4a62-4bb3-9fd6-420733ecee77 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.917535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 428/855] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:29.923504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.923940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.924322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.943445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:29.944717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:30.001046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861d2da-d82c-4e84-9fbb-a5c4b0acd5c4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.017618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.028393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 429/856] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:30.042652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.043398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.043747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.044187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.044966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:30.045378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.047007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.060946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 428/857] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:30.067404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.087145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.181595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c2885-324b-4a6f-aa71-ac93db052e54 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.217304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.218342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.218342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.218534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.219199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6738164d722a43c7b32706caef761fbe) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:30.219511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.220973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.228230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 430/858] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/role_assignments?user.id=6738164d722a43c7b32706caef761fbe&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:30.324940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.441282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb54252-9673-4dfc-8916-5a58d2b86487 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.488555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.489542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.490027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.490452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.504452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:30.510155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:30.511172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:48:30.512098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:30.512744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 429/859] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:30.519527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.607459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.626552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffe614-2680-44f7-a111-f6aa1a355c3e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.663056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.663673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.663956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.664242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.664971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:30.665277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.666715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.676483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 431/860] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:30.682293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.719618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.795003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83416997-534f-43c5-b81f-6c9d8ddb632e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.831445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.832155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.832439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.832713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.844308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.845766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:30.861328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:30.862864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:30.863834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:30.863834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:30.863834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:30.863834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 430/861] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:30.868876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.976314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bc558-39b0-40b4-960b-283acef72342 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:31.012898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:31.013614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.013930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.014211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.014904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:31.015214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:31.016584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:31.029568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 432/862] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:31.035727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:31.128454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:31.146053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52263d-b422-45ec-8d86-835643756a2d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:31.182234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:31.183194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.183626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.184061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.193094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:31.194754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:31.207268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:31.208469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:31.209644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:31.211811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 431/863] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:31.217703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:31.222355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:31.327948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495ee88-f437-423b-b872-880b37c5e513 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:31.365160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:31.366080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.366587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.367012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.367953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:31.368407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:31.370006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2053b-5c68-4217-9a0f-0bda8102b955 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:31.389413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 433/864] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Oct 10 11:48:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:31.394773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:31.510398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412efbd4-e166-48d7-af0c-6a6f2e1d719a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:31.547670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:31.548283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.548567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.548844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.564024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:31.611420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e79ee-0a54-432f-abbe-a5e63e273c01 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.611862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e79ee-0a54-432f-abbe-a5e63e273c01 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.612258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e79ee-0a54-432f-abbe-a5e63e273c01 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.613986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 434/865] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:31.619028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.619446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.619794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.621690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:31.623741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:31.640041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:31.641271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:31.712469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:31.725887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 435/866] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:31.748653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 432/867] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:31.754986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:31.863927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa09c-b548-4104-8a35-ddddbce0c3ac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:31.912545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:31.914153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.914876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.915638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.935034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:31.938339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c1235623-4637-4b6d-84b4-dc821578d101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:31.965282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:31.967025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:31.968743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:31.968743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:31.968743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:31.972603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 436/868] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:31.979682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:32.013012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cef92b-97a7-4955-98d4-d862816cb993 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.013516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cef92b-97a7-4955-98d4-d862816cb993 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.014053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cef92b-97a7-4955-98d4-d862816cb993 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.016940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 437/869] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:32.024866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.025150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.025426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.044687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:32.045905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:32.048229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:32.090508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:32.109661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110acc0-0777-4267-a632-7d80e99822be None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:32.122483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 438/870] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:32.123872 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:32.148229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:32.148939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.149290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.149639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.150383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:32.150759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:32.152437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:32.170379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 433/871] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:32.171830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:32.254423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62eb8b-7fe4-4bee-8647-ed87249a34c2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:32.292465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:32.293549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.294247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.294814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.295685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:32.297411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:32.318215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739346a2-6632-4c8b-80c1-9d22e39e609f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:32.321870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:32.355589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:32.360896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.360896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.360896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.364348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:32.365790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:32.383220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:32.384237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:32.385356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 434/872] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:32.391768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:32.434014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 439/873] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:32 2022] POST /identity/v3/services => generated 269 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:32.434014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:32.507612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:32.543937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3414f4-775a-4b77-bb83-c725503d21b3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:32.608748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3289cc-d1fc-4358-b2f4-91e50d166fde None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:32.616108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:32.617147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.617896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.618594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.619326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:32.619635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:32.621682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:32.645616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 435/874] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:32.646125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:32.654735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7747e-372d-496e-82be-d9330ddb2728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:32.655377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7747e-372d-496e-82be-d9330ddb2728 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.655658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7747e-372d-496e-82be-d9330ddb2728 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.655935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7747e-372d-496e-82be-d9330ddb2728 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.657505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7747e-372d-496e-82be-d9330ddb2728 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:32.659569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7747e-372d-496e-82be-d9330ddb2728 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:32.671385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:32.738029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 440/875] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:32 2022] POST /identity/v3/services => generated 251 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:32.739383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bdaad-dc0b-44ae-9d32-653da2fdbc74 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.739665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bdaad-dc0b-44ae-9d32-653da2fdbc74 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.739940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bdaad-dc0b-44ae-9d32-653da2fdbc74 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.742538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 441/876] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:32.752270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.752580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.752848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.765700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ec66-2f2b-4166-a6a2-a63957f8ae12 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:32.773376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:32.774667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:32.814233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:32.814860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:32.815187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:32.815459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:32.816199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=866d752ffa524c449a285cf975b21d07) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:32.816505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:32.818018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:32.830185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 436/877] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:32 2022] GET /identity/v3/role_assignments?user.id=866d752ffa524c449a285cf975b21d07&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:32.870438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 442/878] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:33.160201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:33.254973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:33.277542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2f10b-e623-4ab7-87c3-161b2c2d6494 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:33.320451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:33.321107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:33.321386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:33.321658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:33.322297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:33.323718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:33.334362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:33.335408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:33.336766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 437/879] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:33.341972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:33.369795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:33.479590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc24b4-a10f-4b95-a20b-d22f39e58e86 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:33.541838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:33.542876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:33.543350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:33.543822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:33.544943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:33.545486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:33.548098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd6d6f-535d-4400-aa98-662a7540960b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:33.556901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 443/880] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:33.562128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:33.667943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b11e1-c0b4-4cbe-98e2-12614202b1e6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:33.703709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:33.704240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:33.704570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:33.704845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:33.705464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:33.705818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:33.707753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea61c5f-71b3-42d8-84c9-b95ff3d87567 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:33.712689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 438/881] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:34.714414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4f07-188a-4d0e-bb2f-3c859af158cd None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:34.714924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4f07-188a-4d0e-bb2f-3c859af158cd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:34.714924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4f07-188a-4d0e-bb2f-3c859af158cd None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:34.716610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 444/882] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:34.722511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf57d-fd02-4faa-be1d-3e530bfdbdc9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:34.722958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf57d-fd02-4faa-be1d-3e530bfdbdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:34.727153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf57d-fd02-4faa-be1d-3e530bfdbdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:34.742180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-370bf57d-fd02-4faa-be1d-3e530bfdbdc9 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:34.743375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-370bf57d-fd02-4faa-be1d-3e530bfdbdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:34.745478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:34.813176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 439/883] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:35.062539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652f9c-6b84-4da2-af7e-aedd5e5bd5c6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.062888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652f9c-6b84-4da2-af7e-aedd5e5bd5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.063072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652f9c-6b84-4da2-af7e-aedd5e5bd5c6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.064490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 445/884] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:35.070486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.070996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.071496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.088963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652f9c-6b84-4da2-af7e-aedd5e5bd5c6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.091107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:35.093518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:35.173100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 440/885] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:35.187857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:35.206660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652f9c-6b84-4da2-af7e-aedd5e5bd5c6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.247312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.247913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.248200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.248476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.249069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.250467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:35.260684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:35.261641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:35.262589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 446/886] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:35.268525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.343524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:35.379437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b161-6c8b-4e6c-a46a-e8a1aab705dd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.415146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.416057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.416514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.416964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.417771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:35.418381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.419919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.425988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 441/887] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:35.434190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.463596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.548983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8805bfa-a334-416d-9dc9-411a06d5fa4f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.584275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.584888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.585164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.585512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.586085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:35.586386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.587789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.588485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bade5b-f20f-48d0-894a-a1a3e50724ba None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.598038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 447/888] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:35.599483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.615341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:35.633431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.638064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:35.642184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.642496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.642773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.643884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.645336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:35.658263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:35.664478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:35.665307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 442/889] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:35.670827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.718788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3eeca0-226a-4f40-82e1-f20e9336a0e3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.759688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.760833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.761343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.761822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.762780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] RBAC: Adding query filter params (interface=public, service_id=04606e6a74104a6fa80b3659498c4ac5, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:35.763294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.765067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.774453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 448/890] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/endpoints?service_id=04606e6a74104a6fa80b3659498c4ac5&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:35.782694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.802244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b22f27-e465-4e90-aa62-10d335a2932a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.855709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.856554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.857047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.857522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.858406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:35.858911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.860690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.867613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 443/891] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:35.873332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:35.878816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:35.897956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467b42-5fd8-4f04-842b-3f0916fac390 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:35.936173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145587aa-d031-4ec7-9fc5-525be0390d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:35.936901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145587aa-d031-4ec7-9fc5-525be0390d6c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.937181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145587aa-d031-4ec7-9fc5-525be0390d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.937809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145587aa-d031-4ec7-9fc5-525be0390d6c None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.938095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145587aa-d031-4ec7-9fc5-525be0390d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:35.939510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145587aa-d031-4ec7-9fc5-525be0390d6c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:35.944514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:35.954243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 449/892] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 11:48:35.956374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532d1d8-eee7-4a49-bdb0-eb5ba9a27ec7 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.956673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532d1d8-eee7-4a49-bdb0-eb5ba9a27ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.956948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532d1d8-eee7-4a49-bdb0-eb5ba9a27ec7 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.958389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 450/893] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:35.959623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088132f-ec2e-4676-8fa9-c60cdca23cb8 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.959884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088132f-ec2e-4676-8fa9-c60cdca23cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.960157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088132f-ec2e-4676-8fa9-c60cdca23cb8 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.965971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 451/894] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:35.967469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:35.967758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:35.968034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:35.987727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:35.988957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:35.994834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201fff1-6100-48ab-91a0-2e895ca884d5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.035558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.036182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.036467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.036743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.037389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:36.037694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:36.039160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d868518-8cef-4472-8e81-f2859de15988 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:36.049883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 444/895] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:36.049883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.049883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.049883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.069195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:36.078134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 452/896] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:36.078378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:36.078479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.159538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:36.183185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 445/897] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:36.211574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5beae1-5eca-4eba-bfdc-0d823834dbaa None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.267796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.269335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.269835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.270371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.271748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] RBAC: Adding query filter params (interface=public, service_id=9eeafc42c82c4278a972cdcf9a374da2, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:36.272312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:36.274800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:36.285240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 453/898] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:36 2022] GET /identity/v3/endpoints?service_id=9eeafc42c82c4278a972cdcf9a374da2&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:36.291400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.355716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:36.405288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325453c6-0dc4-45b5-b7f2-b397df354fbf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.423398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.447817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.448482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.452055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.452371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.453130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:36.455024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:36.468235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 446/899] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:36 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:48:36.469127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.543347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ed56f-61d3-4b96-9938-d0bc43e7d90d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.584715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.585326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe33a-7a8c-4393-8666-ad615122bdb7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.586077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.586608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.587193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.588188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:36.589826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:36.595677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:36.605107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:36.623661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.624319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.624603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.624878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.638118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:36.643274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:36.645671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:36.647556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 447/900] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Oct 10 11:48:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:36.651146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.681935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 454/901] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:36 2022] POST /identity/v3/services => generated 241 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:36.787951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1364cb-383e-4923-ad83-57c104bc6bca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.841301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.842692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.843219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.843672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.844609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:36.845106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:36.846790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:36.857023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 448/902] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:48:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:36.863134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.985937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d825d-e554-4efb-b123-83f58ba9a3c5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:37.028645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:37.029437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:37.029719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:37.030026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:37.043150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:37.044614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:37.059717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:37.060736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:37.061624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:37.061624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:37.061624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:37.061624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 455/903] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:37.066921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:37.111718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:37.186527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e357-41eb-4374-a924-add29c32ffc2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:37.223444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:37.224060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:37.224341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:37.224617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:37.225276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:37.225574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:37.226997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:37.240203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 449/904] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:37.245974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:37.311503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:37.379851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deeb48-3575-42ff-9c8d-f1a6d937c37b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:37.414960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:37.415599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:37.415877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:37.416147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:37.425912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:37.427469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:37.441237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:37.442297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:37.443229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 456/905] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:37.456790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:37.586548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:37.593820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ccb7-52a4-4e70-88f5-3a47750bbd6a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:37.635180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:37.636298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:37.636796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:37.637283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:37.638245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:37.638746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:37.640360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:37.660084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 450/906] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Oct 10 11:48:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:37.665933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:37.777835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c1020-6a99-4dc4-ab42-37309df7ba68 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:37.785690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:37.813819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:37.814457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:37.814730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:37.815637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:37.886895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:37.888342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:37.991790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 457/907] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:37.997271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.103923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc525-0d44-4056-969c-2d4a97d7dfea None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:38.143849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:38.144428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.144712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.144988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.157352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:38.159420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4632de99-c8ed-4362-9a84-c4432bb64ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:38.176075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:38.177095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:38.178001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:38.178001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:38.178001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:38.178001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 451/908] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:38.182903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.198196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:38.263017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1c2ff-bb7f-44cd-90eb-c1ded525f028 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.263333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1c2ff-bb7f-44cd-90eb-c1ded525f028 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.263590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1c2ff-bb7f-44cd-90eb-c1ded525f028 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.265060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 452/909] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:38.270570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.271218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.271780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.291445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b6dd5-03ec-40e6-9c5f-9b13573c02a8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:38.293459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:38.294712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:38.295575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:38.337685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:38.338855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.339363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.339841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.340685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:38.341194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:38.342846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:38.359849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 458/910] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:38.361049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.389874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 453/911] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:38.430961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:38.465405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad6ca4-bb97-437a-abde-df9f566d9f2f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:38.502985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:38.503985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.504489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.504964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.515455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:38.517250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:38.529387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:38.530302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:38.531191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:38.533558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 459/912] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:38.540170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.652385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4541a-9b5f-402b-bbe8-f76fbbf5ffdd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:38.694758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:38.695379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.695705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.695982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.696681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:38.696988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:38.698461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:38.701380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:38.711680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 454/913] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:38.712117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.720940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.837979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211307c-1847-4b5a-b2c1-803613af6432 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:38.855149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549d3e1-0b4b-4e73-96e9-31289acf9969 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:38.868081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:38.879043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:38.879684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.883376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.883376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.883376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:38.883376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d2fedc85-361f-4645-b94d-95665ec0e035 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:38.891215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:38.892590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:38.894096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 460/914] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Oct 10 11:48:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:38.894881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28d2f-5ac2-45fa-89d8-7d6509f76ea1 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.894956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28d2f-5ac2-45fa-89d8-7d6509f76ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.895399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf28d2f-5ac2-45fa-89d8-7d6509f76ea1 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.900532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 461/915] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:38.900532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28d2f-5ac2-45fa-89d8-7d6509f76ea1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:38.906828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:38.907449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.907736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.908009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.908774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] RBAC: Adding query filter params (role.id=28f19f9723304c71bfb5a84b4086f641, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=866d752ffa524c449a285cf975b21d07) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:38.909086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:38.910560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b653e17-7213-413d-a676-c575ad44d111 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:38.916551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 455/916] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:38 2022] GET /identity/v3/role_assignments?user.id=866d752ffa524c449a285cf975b21d07&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=28f19f9723304c71bfb5a84b4086f641 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:38.917579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac1590-7496-4440-8b90-36b6d6c90261 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.917893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac1590-7496-4440-8b90-36b6d6c90261 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.918176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac1590-7496-4440-8b90-36b6d6c90261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.940685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4cac1590-7496-4440-8b90-36b6d6c90261 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:38.942121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4cac1590-7496-4440-8b90-36b6d6c90261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:39.032807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.039386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf28d2f-5ac2-45fa-89d8-7d6509f76ea1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.052315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 456/917] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:39.059800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e725-0f6a-478c-a1cc-1f85a1db5532 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.060119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e725-0f6a-478c-a1cc-1f85a1db5532 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.060372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e725-0f6a-478c-a1cc-1f85a1db5532 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.066233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 457/918] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:39.068456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.068456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.068674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.088684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:39.089572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.089928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:39.090878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.091398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.092001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.092879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:39.093447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.095159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.106881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 462/919] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:39.110071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.174314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.174677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 458/920] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:39.218767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525dcef-df1a-4f98-be42-84e4fea72b51 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.255477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.256533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.257019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.257502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.258365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:39.258871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.260454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.270204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 463/921] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:39.272647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.318882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.387104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c88541-11d3-4850-bdf5-b3d265723eb3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.415797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.433370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.434020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.434614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.434996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.435702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.437309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.450499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cec88-f3ef-4519-a35e-000fdc80457a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.471035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.497141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.497803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.498118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.498397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.499001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.500621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:39.511005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:39.512177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:39.513036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 464/922] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:39.514925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.529878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 459/923] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:39.529878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.636169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155b2e-3bef-4f85-a86a-6914955fdba5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.686260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.687023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.687375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.687715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.688383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.689322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95c0a-ba5b-444a-af03-fb2a468089dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.690496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:39.701134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:39.702471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:39.703517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:39.709892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 465/924] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:39.711929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.735346 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.736026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.736308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.737098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.737785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:39.738130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.740326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.746686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 460/925] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:39.754977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.778601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.810269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.850466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e198acb-0201-464f-a1ef-ab3772e4593c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.885150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e580523-b0b0-4049-a8ab-194b326aaa57 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.895876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.897269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.897773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.898331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.899196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:39.899725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.901511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.907289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 466/926] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:39.917095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.923756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.925260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.925549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.925828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.926819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:39.927129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.928808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.940460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 461/927] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:39.941827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:40.048694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6f12-7114-4eec-a39f-ab96b18470b7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:40.050105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa3aa-1e80-4c08-a400-6cd9ff413552 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:40.053616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:40.060220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:40.091856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:40.092669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:40.092948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:40.093219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:40.094166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:40.095719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:40.095854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:40.097124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:40.097553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:40.098012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:40.098802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:40.099252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:40.100909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:40.107248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 467/928] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:40.114785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:40.176610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 462/929] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:40.237632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01887446-581a-417c-a359-9fd2a2334f36 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:40.288291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:40.289631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:40.290180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:40.290650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:40.291706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] RBAC: Adding query filter params (interface=public, service_id=4094e8f4471242ada7ad369db7efdd5d, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:40.292391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:40.294042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0e593-b7b1-4ed7-9cf2-a6247f0b3ac2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:40.301827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 468/930] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:40 2022] GET /identity/v3/endpoints?service_id=4094e8f4471242ada7ad369db7efdd5d&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:40.313913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:40.432198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c182fc-7d35-4d40-8f7f-5b07f95f7f76 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:40.482607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2d329-b836-4203-92a5-82fdbc2d9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:40.483220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d329-b836-4203-92a5-82fdbc2d9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:40.483615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d329-b836-4203-92a5-82fdbc2d9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:40.483893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d329-b836-4203-92a5-82fdbc2d9dd5 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:40.484515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2d329-b836-4203-92a5-82fdbc2d9dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:40.485940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2d329-b836-4203-92a5-82fdbc2d9dd5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:40.493480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 463/931] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:40 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:48:41.325727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738400-8291-4d1c-861e-d162d7fe5d37 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.326314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738400-8291-4d1c-861e-d162d7fe5d37 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.326314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738400-8291-4d1c-861e-d162d7fe5d37 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.327941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 469/932] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:41.333381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878e02f-d2d5-4354-aad5-643b4bf21bce None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.333830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878e02f-d2d5-4354-aad5-643b4bf21bce None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.333943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878e02f-d2d5-4354-aad5-643b4bf21bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.352802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c878e02f-d2d5-4354-aad5-643b4bf21bce None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:41.354054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c878e02f-d2d5-4354-aad5-643b4bf21bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:41.373806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:41.431739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 464/933] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:41.701300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738400-8291-4d1c-861e-d162d7fe5d37 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:41.734799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:41.826031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738400-8291-4d1c-861e-d162d7fe5d37 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:41.863140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:41.863824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.864113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.864395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.875592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:41.879554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6065-78fd-4d37-8b33-d714e18b300e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.879844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6065-78fd-4d37-8b33-d714e18b300e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.880117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6065-78fd-4d37-8b33-d714e18b300e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:41.881444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:41.882441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:41.883324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:41.884006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 465/935] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:41.884082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 470/935] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Oct 10 11:48:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:41.886998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.887391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.887851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.888486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:41.907887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:41.909135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:41.992823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:41.997550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 466/936] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:42.007354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7120-8eb5-4980-8d7b-3cdf8e24febf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.044052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.045002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.045500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.046018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.046898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:42.047409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.049587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.060608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 471/937] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:48:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:42.071209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.164045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:42.181230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ff49-de13-4d56-9c52-a8ebf4ecd768 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.217820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.218906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.219399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.219891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.230718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.232434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:42.248570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:42.249587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:42.250508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:42.250508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:42.250508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:42.253399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 467/938] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:42.258985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.269778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.399548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf20d1f-770f-43d3-94fd-b89e1645d021 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.418309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34568d3-a55c-4926-b6ec-cf633280f312 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.466700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.467318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.467596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.467863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.468511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:42.468810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.470346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cf490-9ff6-4830-ab62-12f92b30c20d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.474985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.476585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.477369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.478375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.479737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.482786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.483669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 472/939] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:42.484933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4ea8-a786-4388-ae8b-d3d99a682cfd None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.485218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4ea8-a786-4388-ae8b-d3d99a682cfd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.485489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4ea8-a786-4388-ae8b-d3d99a682cfd None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.487325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 473/940] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:42.489104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4ea8-a786-4388-ae8b-d3d99a682cfd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.489766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-debdf20c-c48b-4726-bbe6-55b08b8c046c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:42.497624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:42.506800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:42.507662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 468/941] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:42.508470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.508470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.508470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.516557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:42.520971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:42.522202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:42.595582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 469/942] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:42.603129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.681131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4ea8-a786-4388-ae8b-d3d99a682cfd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.724339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.725224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.725507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.725779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.735909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.737657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ce40e-ba43-480d-8acf-9f9d38d954a6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.737904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:42.753830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:42.754846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:42.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:42.758078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 474/943] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:42.761060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.782344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:42.788155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.788958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.789092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.789295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.789967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:42.790264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.791635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf769a8-840b-46af-be44-0b5a08499053 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.797901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 470/944] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:42.797901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acc48b-d86d-46b5-b0c0-9f0ad57dbeb0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.798868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acc48b-d86d-46b5-b0c0-9f0ad57dbeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.798868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acc48b-d86d-46b5-b0c0-9f0ad57dbeb0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.800016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 471/945] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:42.802375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acc48b-d86d-46b5-b0c0-9f0ad57dbeb0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.840588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:42.871352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b2493-ced9-4563-b2cd-d3d811e0eede None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.905803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.906434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.906712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.906989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.907709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:42.908018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.909480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eea5e-b10a-4f77-ba82-ae60c0904bb8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.914086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acc48b-d86d-46b5-b0c0-9f0ad57dbeb0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.927139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 475/946] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:42.928380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.928667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.928949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.947323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:42.948536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:42.948906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.949516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.949793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.950092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.950721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:42.951019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.952379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.956861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 472/947] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:42.957622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.025424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.029896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 476/948] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:43.029896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.086175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d9e7-afd5-45a7-ad0b-cf7b01e5b0b3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.126015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.127793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.128072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.128351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.129118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.130698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.133463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING keystone.server.flask.common [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 10 11:48:43.136195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.181712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.sql.core [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 11:48:43.181712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 11:48:43.181712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [parameters: {'id': '87d0b1ad5d3d4d9ca7304fd5eb013767', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 10 11:48:43.181712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87d0b1ad5d3d4d9ca7304fd5eb013767.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87d0b1ad5d3d4d9ca7304fd5eb013767. Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:48:43.188675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 10 11:48:43.189479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application yield resource Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise self.value Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application session.commit() Oct 10 11:48:43.191467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.flush() Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application compat.raise_( Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 11:48:43.192635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 11:48:43.193712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:48:43.194773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [parameters: {'id': '87d0b1ad5d3d4d9ca7304fd5eb013767', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.195959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:43.196963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87d0b1ad5d3d4d9ca7304fd5eb013767. Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 473/949] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Oct 10 11:48:42 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:43.198101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.199062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6e030-0ddd-4773-abe0-8a3ad39f31e8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.238553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.239458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.240236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.240598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.255590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.261390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:43.279579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:43.280592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:43.281477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:43.281477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:43.281477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:43.284105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 477/950] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:43.289962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.337494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b9f2-9054-4010-a04d-6e8aa0f35778 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.352213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.372834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.373635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.373928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.374271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.381806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.383478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:43.396967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:43.402743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 474/951] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:43.403842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.412834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c6b4c-605d-400b-b4a0-cd5eeef2bc28 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.426548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.451207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.452103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.452743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.453023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.453694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:43.454454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.457805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.474377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 478/952] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:43.476169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.526099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff14569-d9d7-4ecd-b5ac-bb4bd2e72cb8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.563690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.564246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.564530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.565366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.565987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.567387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:43.576232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:43.577539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.578517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 475/953] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:43.579322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.593324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9833c0-fc3d-472b-bcea-7ca76183ca27 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.624397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.635895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.636563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.636848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.637175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.637864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:43.638642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.640379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.673907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 479/954] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:43.673907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.688156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55658f57-8bcd-4c25-92a9-124c6722afa0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.719376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.732820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.733567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.733885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.734191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.742780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.744330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:43.762593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:43.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:43.764537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:43.767404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 476/955] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:43.770931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.822136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d6bf1-48bd-4613-904d-4d919b2a1d0e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.864886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.865529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.865816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.866143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.866886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:43.867184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.868847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.877249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 480/956] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:43.885045 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:43.910337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:43.915504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6eedd-967d-4454-880d-0534ae8c0582 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:43.964546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:43.965167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:43.965453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:43.965724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:43.966460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:43.966766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:43.968769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:43.989528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 477/957] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:43.995269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:44.016661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:44.025492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c535a-ea46-4c81-91e2-dfb8d327e681 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:44.068743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:44.069481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:44.069726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:44.069945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:44.070580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:44.070883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:44.072326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:44.077890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 481/958] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:44.083360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:44.109552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e86ad-b7eb-4fa7-a4d1-ef6ae17d2a55 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:44.153907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae456c-bd6c-45d5-be49-7df850ced5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:44.155016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae456c-bd6c-45d5-be49-7df850ced5e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:44.155955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae456c-bd6c-45d5-be49-7df850ced5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:44.156446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae456c-bd6c-45d5-be49-7df850ced5e7 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/866d752ffa524c449a285cf975b21d07/roles/28f19f9723304c71bfb5a84b4086f641` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:44.160491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae456c-bd6c-45d5-be49-7df850ced5e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=866d752ffa524c449a285cf975b21d07, role_id=28f19f9723304c71bfb5a84b4086f641)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:44.162296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae456c-bd6c-45d5-be49-7df850ced5e7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:44.218079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d49d-710b-4c77-a7fa-4b0229c3b6a3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:44.254968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143874-78cb-4ada-96df-4c35f90e55df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:44.255639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143874-78cb-4ada-96df-4c35f90e55df None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:44.255923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143874-78cb-4ada-96df-4c35f90e55df None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:44.256258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143874-78cb-4ada-96df-4c35f90e55df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:44.256936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143874-78cb-4ada-96df-4c35f90e55df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:44.258411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143874-78cb-4ada-96df-4c35f90e55df None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:44.280463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 478/959] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:43 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/866d752ffa524c449a285cf975b21d07/roles/28f19f9723304c71bfb5a84b4086f641 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:48:44.353674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 482/960] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:45.185208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fe03-32e0-456b-9268-25abd1b89200 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.185208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fe03-32e0-456b-9268-25abd1b89200 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.185208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377fe03-32e0-456b-9268-25abd1b89200 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.187062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 479/961] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:45.192592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e79a-cbe4-436f-baac-5d8fd055c7a3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.193403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e79a-cbe4-436f-baac-5d8fd055c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.193949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382e79a-cbe4-436f-baac-5d8fd055c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.222359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d382e79a-cbe4-436f-baac-5d8fd055c7a3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:45.225890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d382e79a-cbe4-436f-baac-5d8fd055c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:45.241076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.311853 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 483/962] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:45.588018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fe03-32e0-456b-9268-25abd1b89200 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:45.608726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.702603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377fe03-32e0-456b-9268-25abd1b89200 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.739470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc21b0-1f6f-43db-82a2-9c20d09e94f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.740016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc21b0-1f6f-43db-82a2-9c20d09e94f3 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.740297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc21b0-1f6f-43db-82a2-9c20d09e94f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.740571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc21b0-1f6f-43db-82a2-9c20d09e94f3 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.741228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc21b0-1f6f-43db-82a2-9c20d09e94f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:45.742646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc21b0-1f6f-43db-82a2-9c20d09e94f3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:45.834290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 480/963] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:45 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:46.018985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5a04-aa47-4319-b3f5-46d19e6a8ba0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.019333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5a04-aa47-4319-b3f5-46d19e6a8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.019506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5a04-aa47-4319-b3f5-46d19e6a8ba0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.020947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 484/964] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:46.026635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698021c-c6ac-41b0-8391-e3621b8036a6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.027145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698021c-c6ac-41b0-8391-e3621b8036a6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.027420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698021c-c6ac-41b0-8391-e3621b8036a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.047534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5698021c-c6ac-41b0-8391-e3621b8036a6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:46.049595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5698021c-c6ac-41b0-8391-e3621b8036a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:46.130475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 481/965] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:46.400013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b5a04-aa47-4319-b3f5-46d19e6a8ba0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:46.539502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b5a04-aa47-4319-b3f5-46d19e6a8ba0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:46.579576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:46.580709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.580985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.581296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.582044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:46.583543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:46.586162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING keystone.server.flask.common [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 10 11:48:46.635240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3329-9213-47a2-a910-6bddde9aaefc None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.635754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3329-9213-47a2-a910-6bddde9aaefc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.635754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3329-9213-47a2-a910-6bddde9aaefc None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.637355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 482/966] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:46.637958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.sql.core [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 11:48:46.637958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 10 11:48:46.637958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [parameters: {'user_id': '08fde270cbda4d81858202ec2e445585', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 10 11:48:46.637958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81598) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 11:48:46.641954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b672-99fc-431f-ba98-30cef07015c7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.642257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b672-99fc-431f-ba98-30cef07015c7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.643056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b672-99fc-431f-ba98-30cef07015c7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.644557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 483/967] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:46.645443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.645726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.646036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.654857 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4b2f8237-8e50-4d50-9b8d-82a31a75ec2e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result.read() Oct 10 11:48:46.656604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:48:46.657597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application yield resource Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise self.value Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application session.commit() Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 11:48:46.679757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.session.flush() Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application compat.raise_( Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 11:48:46.680694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:48:46.681799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application result.read() Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:48:46.682698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [parameters: {'user_id': '08fde270cbda4d81858202ec2e445585', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:46.683618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 10 11:48:46.684420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 485/968] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Oct 10 11:48:46 2022] POST /identity/v3/users => generated 160 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.685455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.687997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:46.687997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:46.688259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:46.688259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:46.688259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:46.748652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 484/969] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:46.749806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:46.765078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 486/970] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:46.859361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12783d8-c90b-4ef8-86fa-7d4c0b3977d1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:46.894446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:46.895377 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:46.895852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:46.896337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:46.898498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:46.903916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:46.905552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:46.917481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:46.919960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:46.921016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 485/971] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:46.925680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.024541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.048261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072524dd-9f67-4fa7-9c2a-c9df95e56617 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.093524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203323c-e904-469e-8013-afba4a545591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.094192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203323c-e904-469e-8013-afba4a545591 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.094457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203323c-e904-469e-8013-afba4a545591 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.094790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203323c-e904-469e-8013-afba4a545591 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.095529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203323c-e904-469e-8013-afba4a545591 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:47.096384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203323c-e904-469e-8013-afba4a545591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.098039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203323c-e904-469e-8013-afba4a545591 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.100070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:47.144382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b6c7d-74d9-40c2-862a-934d962c7fb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.145164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 487/972] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Oct 10 11:48:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:47.146167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203323c-e904-469e-8013-afba4a545591 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.200134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.201360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.201360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.201360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.217334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:47.224576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:47.225627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:47.226666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:47.230522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 486/973] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:47.232615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.301211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203323c-e904-469e-8013-afba4a545591 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.306683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:47.356066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.356728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.357011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.357289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.357956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.359620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:47.369672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:47.370751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:47.372424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 488/974] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:47.377527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.378399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e728b-70a9-483d-b988-c46659823abe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.439320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.439999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.440283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.440557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.441234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:47.441539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.443010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.453359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 487/975] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:47.460052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.463716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:47.520468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987f605-0102-404a-8495-87955109a0a8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.558061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.558685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.558966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.559244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.559883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:47.560189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.561656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.573635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 489/976] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:47.575072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.617014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa997c-c6fc-4417-847a-58725e96248a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.639245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:47.658345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.658977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.659255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.659521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.670426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.671873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:47.687241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:47.688439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:47.689347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:47.689347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:47.689347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:47.689347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 488/977] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:47.694822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.715297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e521d1-9ad5-4f62-9c36-921097c15e7e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.733450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:47.748020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.748633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.748914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.749187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.749819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:47.750156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.751770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.757451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 490/978] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:47.762949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.811159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ec55-d791-46e4-be8d-e62cfba64bb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.851625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.852330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.852514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.852786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.853431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:47.853736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.855152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.871798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 489/979] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:47.872973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.876633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff093-903d-4f1f-aa87-af6cc48a4b34 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.903565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:47.914341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:47.914954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:47.915236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:47.917165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:47.917165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] RBAC: Adding query filter params (interface=admin, service_id=4094e8f4471242ada7ad369db7efdd5d, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:47.917165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:47.917936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:47.923273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 491/980] 10.222.0.47 () {56 vars in 1249 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/endpoints?service_id=4094e8f4471242ada7ad369db7efdd5d&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:47.928983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:47.990880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda2fe-e47c-4783-96c4-b600917e476c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:47.994774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.028727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.029362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.029823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.029968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.037638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.039109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:48.051444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:48.052395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:48:48.053328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:48.054436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74aa7b-dd82-45d3-9c10-47938623f28e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.057304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 490/981] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:48.058187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.088905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1d67-691c-4395-96ae-ebd0b64b2b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.089512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1d67-691c-4395-96ae-ebd0b64b2b27 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.089792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1d67-691c-4395-96ae-ebd0b64b2b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.090093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1d67-691c-4395-96ae-ebd0b64b2b27 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.090696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1d67-691c-4395-96ae-ebd0b64b2b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.092062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1d67-691c-4395-96ae-ebd0b64b2b27 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.098469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 492/982] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:47 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:48:48.098469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289364d-2a8c-4c82-9dc1-61f19b981ff8 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.098469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289364d-2a8c-4c82-9dc1-61f19b981ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.098469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289364d-2a8c-4c82-9dc1-61f19b981ff8 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.098469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 493/983] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:48.107372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.107654 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.107923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.128316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:48.129656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:48.163956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.177912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183266dc-901d-48d9-a7f5-b53be0c24ecd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.217179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.217807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.218117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.218387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.219135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:48.219441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.219678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 494/984] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:48.221453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.242100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 491/985] 10.222.0.47 () {56 vars in 1149 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:48.247741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.295955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.359130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755a94d-8541-4376-83c0-e59d0b511cfe None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.396270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.396874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.397150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.397415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.474375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.476664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.485584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.526301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.593378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 495/986] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:48.594449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.600692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838a37-ac51-48d3-8b90-35a9ed2f161c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.637765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.638534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.638808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.639075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.639650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.641113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:48.650936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:48.651952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:48.652803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 492/987] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:48.657943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.671162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.715303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33068e2-8ad3-4ad6-8f9c-8e2b68a7797d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.753516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.754182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.754463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.754736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.765534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.767024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.768868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.769091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc633-e50e-4ed7-94bd-178266567736 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:48.781970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:48.783110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:48.784332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:48.784332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:48.784332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:48.784332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 496/988] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:48.789291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.808798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.809643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.810092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.810504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.811277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:48.811748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.813261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.819059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 493/989] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:48.824779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.897615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656b28-c02f-4006-8dd3-4a310fefb45c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.903826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.931091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66822-c22a-4ca6-ac03-880685911ff3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.931713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.932324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.932608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.932885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.933523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:48.933827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.935221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.947720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 497/990] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:48.953176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.971580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.972446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.972724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.972993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.973609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:48.973943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.975293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.980243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 494/991] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:48.986006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:49.018518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:49.065116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98ac10-2175-48c7-afab-965e86965ef2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:49.098597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d68eeb-9391-478d-a96c-170af435bec1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:49.100428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:49.101635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:49.101635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:49.101635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:49.108570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:49.110072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:49.121194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:49.122234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:49.123261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 498/992] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:49.128702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:49.138098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:49.138903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:49.139357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:49.139777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:49.140613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] RBAC: Adding query filter params (interface=public, service_id=9827cfade794499680948713284cd9f1, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:49.141081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:49.143177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:49.148889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 495/993] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/endpoints?service_id=9827cfade794499680948713284cd9f1&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:49.154620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:49.157924 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:49.241746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dddb-1636-4663-ba4a-199a2c44080c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:49.258037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:49.263267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf1c7-9ae4-4d4f-a0ca-0cea50689be5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:49.281865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:49.282483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:49.282767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:49.283090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:49.283859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:49.284166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:49.285641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:49.298255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 499/994] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:49.304315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d62f8-aadd-4699-bc81-237a95f36517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:49.304463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:49.305204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d62f8-aadd-4699-bc81-237a95f36517 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:49.305483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d62f8-aadd-4699-bc81-237a95f36517 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:49.305753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d62f8-aadd-4699-bc81-237a95f36517 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:49.306393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d62f8-aadd-4699-bc81-237a95f36517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:49.308861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d62f8-aadd-4699-bc81-237a95f36517 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:49.319131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 496/995] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:49 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:48:49.419395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05849eb4-9ede-472f-b21e-f09aca40b141 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:49.462880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:49.463506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:49.463805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:49.464079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:49.464809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] RBAC: Adding query filter params (role.id=28f19f9723304c71bfb5a84b4086f641, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=866d752ffa524c449a285cf975b21d07) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:49.465115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:49.466591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b7fa1-9d72-4d95-ab0f-aff147895570 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:49.474039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 500/996] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:49 2022] GET /identity/v3/role_assignments?user.id=866d752ffa524c449a285cf975b21d07&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=28f19f9723304c71bfb5a84b4086f641 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:50.292117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc658d99-ce40-45ab-9527-baa8aa160b79 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:50.292644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc658d99-ce40-45ab-9527-baa8aa160b79 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:50.292644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc658d99-ce40-45ab-9527-baa8aa160b79 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:50.294164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 497/997] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:50.299401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:50.300037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:50.300037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:50.318429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:50.319628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:50.353962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:50.395199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 501/998] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:50.666120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc658d99-ce40-45ab-9527-baa8aa160b79 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:50.737617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:50.775513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc658d99-ce40-45ab-9527-baa8aa160b79 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:50.811403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:50.812036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:50.812312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:50.812585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:50.813167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:50.814603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:50.823668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:50.824830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:48:50.825784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:50.829723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 498/999] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Oct 10 11:48:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:50.831200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:50.935057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aa831-1341-4635-b39b-aca7c6352275 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:50.971759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:50.972375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:50.972652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:50.972922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:50.973567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:50.973889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:50.975243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:50.980367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 502/1000] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:50.986768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:51.098391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b2f88-6c09-43e6-8bc8-97f60f8061e0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:51.130335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:51.137294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:51.137951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.138248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.138511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.139198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:51.139554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:51.140912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b3a38-5dcf-468e-b36d-cb60ac0ddbce None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:51.152037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 499/1001] 10.222.0.47 () {56 vars in 1122 bytes} [Mon Oct 10 11:48:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:51.153788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:51.191115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:51.268615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba9d53-4558-4a10-b31a-e805b1989de7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:51.311751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec0fcd-ae94-4d0c-9993-7011969afe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:51.312414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec0fcd-ae94-4d0c-9993-7011969afe3f None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.312654 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec0fcd-ae94-4d0c-9993-7011969afe3f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.312905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec0fcd-ae94-4d0c-9993-7011969afe3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.313581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec0fcd-ae94-4d0c-9993-7011969afe3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:51.315034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec0fcd-ae94-4d0c-9993-7011969afe3f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:51.433887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 503/1002] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:51.529924 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfd1e2-9d92-4218-beb3-6b24d9947e97 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.530446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfd1e2-9d92-4218-beb3-6b24d9947e97 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.530563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfd1e2-9d92-4218-beb3-6b24d9947e97 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.531921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 500/1003] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:51.538494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0d8f-dace-404d-b9e2-0a18e2f49fc7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.538803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0d8f-dace-404d-b9e2-0a18e2f49fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.539060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0d8f-dace-404d-b9e2-0a18e2f49fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.558949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-00ab0d8f-dace-404d-b9e2-0a18e2f49fc7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:51.560213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-00ab0d8f-dace-404d-b9e2-0a18e2f49fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:51.647900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 504/1004] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:51.700158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ded80-194b-4697-aeeb-a51fc254af6d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.700446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ded80-194b-4697-aeeb-a51fc254af6d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.700719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ded80-194b-4697-aeeb-a51fc254af6d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.702398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 501/1005] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:51.708472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.708697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.708979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.727756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:51.728900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:51.743094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:51.798900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 505/1006] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:51.923075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ded80-194b-4697-aeeb-a51fc254af6d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.029705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ded80-194b-4697-aeeb-a51fc254af6d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.062671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.064234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.064874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.065157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.065446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.066041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.067406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:52.079136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:52.080693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:52.081525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 502/1007] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:52.086989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.151456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:52.178267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6cf9-967a-4f6d-9336-a49357c50c73 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.198485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd48ec1-568b-4dc3-92d0-207a50582a0a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.216488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.217127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.217411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.217688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] PATH_INFO: `/v3/services/image` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.218303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.219669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:52.229082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:52.230144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:52.231553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 506/1008] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:52.236746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.237437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.238089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.238375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.238649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.239284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:52.239592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.240956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.251337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 503/1009] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:52.252276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.253048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:52.347845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6136-deee-4816-87b6-fc39f100abcc None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.362918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb419478-50c0-4a6e-83fe-5e3e9863f255 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.386976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:52.387961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.388570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.388842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.389113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.389783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] RBAC: Adding query filter params (name=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:52.390059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.391421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.397271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 507/1010] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:52.400418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.400631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.401074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.401351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.402080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:52.402386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.402833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.403745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.409679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 504/1011] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:52.415152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.494037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:52.517957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526cd1-6472-4191-a32d-f5759d3ecd36 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.537289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b60bcf-df01-40d7-bb67-510dc70f2d0f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.554138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.554749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.555130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.555330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.555914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] RBAC: Adding query filter params (type=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:52.556216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.557565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137956-a3fc-4db2-8e71-b6116199da5d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.562271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 508/1012] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:52.575350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6996a5-daa6-4125-81d9-4e3972bf95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.575982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6996a5-daa6-4125-81d9-4e3972bf95ca None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.576266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6996a5-daa6-4125-81d9-4e3972bf95ca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.576539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6996a5-daa6-4125-81d9-4e3972bf95ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.577224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6996a5-daa6-4125-81d9-4e3972bf95ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.578682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6996a5-daa6-4125-81d9-4e3972bf95ca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.663066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 505/1013] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:48:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:53.618881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ca49-1a75-4ae9-a771-599630b3c2d2 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:53.619395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ca49-1a75-4ae9-a771-599630b3c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:53.619473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ca49-1a75-4ae9-a771-599630b3c2d2 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:53.620928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 509/1014] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:53.626046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:53.626723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:53.626897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:53.646435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:53.647627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:53.685300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:53.724906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 506/1015] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:53 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:53.990780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ca49-1a75-4ae9-a771-599630b3c2d2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:54.102219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ca49-1a75-4ae9-a771-599630b3c2d2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:54.139935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009f142-6e8d-4a15-a425-34185003e8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:54.140592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009f142-6e8d-4a15-a425-34185003e8eb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:54.140868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009f142-6e8d-4a15-a425-34185003e8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:54.141185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009f142-6e8d-4a15-a425-34185003e8eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:54.142412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009f142-6e8d-4a15-a425-34185003e8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:54.143907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009f142-6e8d-4a15-a425-34185003e8eb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:54.145726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 510/1016] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:54.151475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:54.261192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c0aa7-1004-4d9e-b817-1df3a8014e3b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:54.297082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8625-1152-47e1-a16a-617fd3bc8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:54.297692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8625-1152-47e1-a16a-617fd3bc8056 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:54.298002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8625-1152-47e1-a16a-617fd3bc8056 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:54.298278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8625-1152-47e1-a16a-617fd3bc8056 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:54.299012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8625-1152-47e1-a16a-617fd3bc8056 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:54.300407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8625-1152-47e1-a16a-617fd3bc8056 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:54.389893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 507/1017] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:54 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:54.737376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f6f8-665a-4386-8917-7c77aa4a5140 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:54.737927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f6f8-665a-4386-8917-7c77aa4a5140 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:54.738009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f6f8-665a-4386-8917-7c77aa4a5140 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:54.739471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 511/1018] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:54.744893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125142d-4649-4d34-bc63-1049803c7d0a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:54.745351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125142d-4649-4d34-bc63-1049803c7d0a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:54.745430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125142d-4649-4d34-bc63-1049803c7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:54.764981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9125142d-4649-4d34-bc63-1049803c7d0a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:54.766331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9125142d-4649-4d34-bc63-1049803c7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:54.782284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:54.842492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 508/1019] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:54 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:54.922782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e3f9-5468-4c8d-9ec3-30ea59dfced0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:54.923103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e3f9-5468-4c8d-9ec3-30ea59dfced0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:54.923339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e3f9-5468-4c8d-9ec3-30ea59dfced0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:54.925711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 512/1020] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:54.930723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:54.931007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:54.931277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:54.949724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:54.950922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:55.021695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 509/1021] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:54 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:55.110010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e3f9-5468-4c8d-9ec3-30ea59dfced0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:55.121661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:55.216141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e3f9-5468-4c8d-9ec3-30ea59dfced0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:55.251523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:55.252188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:55.252518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:55.252717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:55.253371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:55.254791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:55.287456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:55.326315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 513/1022] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:55 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:55.378130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:55.399563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc69b9-0a25-4411-a035-5804a1e984b6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:55.446953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:55.447595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:55.451194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:55.451194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:55.468267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:55.473445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:55.474698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:55.476141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:55.477221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 510/1023] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Oct 10 11:48:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:55.481604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:55.555111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:55.590520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bfe8b-50f7-4525-8105-ea3d3535a61f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:55.624710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:55.625325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:55.625602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:55.625889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:55.627381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:55.627676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:55.629038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:55.642664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 514/1024] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:48:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:55.644394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:55.746717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdf79c-2cc2-43b9-9333-271682cef877 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:55.781880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:55.782513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:55.782816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:55.783087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:55.785929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:55.794200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:55.795667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:55.811131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:55.812178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:55.818786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:55.818786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:55.818786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:55.818786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 511/1025] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:55.820529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:55.927200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41e3a-4cc7-4123-80a3-ece268427698 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:55.956252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:55.962600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:55.963297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:55.963579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:55.963857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:55.964498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:55.964802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:55.966204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:55.982197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 515/1026] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:55.983761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:56.089762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64240eb-6a4f-4e99-80a2-e39d85c7b554 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:56.124794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:56.125430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:56.125710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:56.126251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:56.134670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:56.136100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:56.148294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:56.149295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:56.154939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 512/1027] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:48:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:56.157443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:56.263473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8432ba-5c6c-49f7-a194-7f6d34fd6689 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:56.297182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:56.297795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:56.298111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:56.298907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:56.299636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:56.299945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:56.301369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a17b09-e38f-45b5-b6d0-1ec6094eeb0b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:56.323958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 516/1028] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:48:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:56.325723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:56.375583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:56.427992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891d313-74e9-45bd-845a-85970d09fd48 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:56.472473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:56.473116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:56.473398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:56.473670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:56.576255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:56.577799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:56.593148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c950-b816-47fd-b419-4be582421b0c None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:56.593466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c950-b816-47fd-b419-4be582421b0c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:56.594662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c950-b816-47fd-b419-4be582421b0c None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:56.595943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 517/1029] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:56.602347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:56.602347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:56.602347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:56.622186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:56.623405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:56.649659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:56.683314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:56.710170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 518/1030] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:56.715208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 513/1031] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:56.717175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:56.829809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00a734-ee9a-4fec-be23-6943140d732f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:56.864192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:56.864818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:56.865147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:56.865421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:56.875526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:56.877244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:56.891666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:56.892708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:56.898333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:56.898333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:56.898333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:56.898333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 519/1032] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:56.900286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:56.979334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:57.002348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c054b9-1901-4a1e-a7ea-b7cd605a8716 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:57.018761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:57.040591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:57.041242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.041527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.041797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.042478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:57.042780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:57.044152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:57.057187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 514/1033] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:57.062863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:57.075199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:57.092512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a5a0a-4260-43c7-b1c0-5953d57d69a7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:57.131426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:57.132070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.132349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.132638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.133819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:57.135279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:57.137054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 520/1034] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:57.142508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:57.185841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc8be-af42-49d9-a851-fa6509b265d4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:57.229390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:57.230504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.231101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.231385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.240798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:57.242427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:57.243687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:57.247835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492c500-493e-4630-911d-f9a9b97893a9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:57.257948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:57.258901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:48:57.263071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 515/1035] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:57.264190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:57.297146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:57.297823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.298130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.298902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.299620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:57.301163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:57.339307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:57.374216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29ab8-a672-4eff-8499-010a96f8069c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:57.398938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 521/1036] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:48:57 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:57.412763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:57.413478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.413756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.414090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.414885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:57.415196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:57.416747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe3e4cb-d85b-4679-9256-6b4548d765fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:57.433837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 516/1037] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:57.440836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:57.535839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb53e0-788b-47a3-8168-18f7f89d082c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.536175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb53e0-788b-47a3-8168-18f7f89d082c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.536394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb53e0-788b-47a3-8168-18f7f89d082c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.537890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 517/1038] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:48:57.544103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.544391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.544669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.565219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:57.566482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:57.577538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb3f7e-38b7-4bd4-84be-6becad3e2dba None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:57.622544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:57.623241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:57.623524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:57.623805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:57.624591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] RBAC: Adding query filter params (role.id=28f19f9723304c71bfb5a84b4086f641, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6384fbfdbff1461594e0e4f877bc8e5e) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:57.624896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:57.626670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:57.633543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 522/1039] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:57 2022] GET /identity/v3/role_assignments?user.id=6384fbfdbff1461594e0e4f877bc8e5e&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=28f19f9723304c71bfb5a84b4086f641 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:57.655938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 518/1040] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:48:57.933461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:57.954795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:58.043279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471048-c917-4a12-9a92-df8f5b588dc5 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:58.078570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:58.079211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:58.079492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:58.080310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] PATH_INFO: `/v3/services/image` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:58.080900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:58.082329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:58.091621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:58.092699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:48:58.093884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 523/1041] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Oct 10 11:48:57 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:58.099357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:58.162919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:58.209080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f702e2-77a8-4ab2-9fb2-2d1b627e77f3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:58.248762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:58.249393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:58.249673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:58.249977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:58.250630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:58.251175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:58.252727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:58.258732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 519/1042] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:58.264508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:58.357976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:58.380068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d014f7-e05b-49cb-a6f9-1e9008e0ad8f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:58.421799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:58.422440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:58.422728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:58.423066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:58.423771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] RBAC: Adding query filter params (type=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:58.424080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:58.425453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:58.430970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 524/1043] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:58.436741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:58.552172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac456789-752a-4b99-95db-25d21d78f9a8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:58.575374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:58.587765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:58.588488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:58.588869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:58.589242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:58.590092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] RBAC: Adding query filter params (interface=public, service_id=9797097bec5842d881ce1464521441e7, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:58.590499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:58.592065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb698c2-179c-4dcc-89f9-a353224c0973 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:58.601889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 520/1044] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:48:58 2022] GET /identity/v3/endpoints?service_id=9797097bec5842d881ce1464521441e7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:58.604208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:58.705361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1b130-6b09-428e-9ee6-5821b0021778 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:58.740619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801e6aa-3fda-4939-9903-55de5d539ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:58.741382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801e6aa-3fda-4939-9903-55de5d539ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:58.741775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801e6aa-3fda-4939-9903-55de5d539ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:58.742183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801e6aa-3fda-4939-9903-55de5d539ce1 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:58.742887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801e6aa-3fda-4939-9903-55de5d539ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:58.744368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801e6aa-3fda-4939-9903-55de5d539ce1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:58.758123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 525/1045] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:48:58 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:48:59.667197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d718d55-e74a-4ea4-b151-3842d44e124b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:59.667756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d718d55-e74a-4ea4-b151-3842d44e124b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:59.667756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d718d55-e74a-4ea4-b151-3842d44e124b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:59.669389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 521/1046] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:59.675750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd58be0-e7c0-4182-99a8-9f650296b1e1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:59.676314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd58be0-e7c0-4182-99a8-9f650296b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:59.676314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd58be0-e7c0-4182-99a8-9f650296b1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:59.696154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6dd58be0-e7c0-4182-99a8-9f650296b1e1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:59.697369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6dd58be0-e7c0-4182-99a8-9f650296b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:59.700466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:59.767685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 526/1047] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:59.781498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41239c-f73e-4f6b-9d29-61bf4fcfebd0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:59.781776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41239c-f73e-4f6b-9d29-61bf4fcfebd0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:59.782085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41239c-f73e-4f6b-9d29-61bf4fcfebd0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:59.784054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 522/1048] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:59.788917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:59.789206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:59.789475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:59.807999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:59.809176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:59.876277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 527/1049] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:00.038297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41239c-f73e-4f6b-9d29-61bf4fcfebd0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.138540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.146413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41239c-f73e-4f6b-9d29-61bf4fcfebd0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.181973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.182606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.182879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.183150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.194035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:00.198714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:00.199691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:00.200598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 523/1050] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:00.205705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.217272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:00.250430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae6f2-3809-4326-9763-ab045ec1055a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.258433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:00.286988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.287635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.287920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.288200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.299449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:00.304184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:00.305127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:00.306035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 528/1051] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:00.311200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.319153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f136c-5ca6-426a-ae57-8fcd8463fa85 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.360567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.362417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.362709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.362990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.363666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:00.363972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:00.365360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:00.380762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 524/1052] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:00.381883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.433806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088511c5-5d3e-468d-8d65-ed78ce035923 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.475774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:00.481692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.482744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.483246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.489142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.489142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:00.489142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:00.489142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:00.502593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 529/1053] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:00.508340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.514270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c7e14-e5cb-44fb-a0db-2029e1e4fdfc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.524340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:00.552622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.553177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.553458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.553732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] PATH_INFO: `/v3/users/f5508e43101d41fb9bda7831a9b21ff4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.569439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f5508e43101d41fb9bda7831a9b21ff4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:00.570930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:00.572777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 525/1054] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/users/f5508e43101d41fb9bda7831a9b21ff4 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:00.578257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.626951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdbe3-f1e9-409f-b374-b9354d2d6bb2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.661493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.662155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.662433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.662705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.674599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:00.676098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:00.690379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:00.691354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:00.692284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:00.692284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:00.692284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:00.692284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 530/1055] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:00.697091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.699256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445e17-fe29-4a34-a126-cb9b865a12c7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.738860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dec0e6-b9e7-4a79-9fac-70ba6228ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.739449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec0e6-b9e7-4a79-9fac-70ba6228ae72 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.739725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec0e6-b9e7-4a79-9fac-70ba6228ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.740004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec0e6-b9e7-4a79-9fac-70ba6228ae72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.746077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:00.778867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:00.804436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81a76f-4efd-4e75-9994-8593ab81934e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.818974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dec0e6-b9e7-4a79-9fac-70ba6228ae72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:00.820485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dec0e6-b9e7-4a79-9fac-70ba6228ae72 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:00.848568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:00.849188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.849488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.849737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.850496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:00.850724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:00.852108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:00.866884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 531/1056] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:00.872458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.937739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 526/1057] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 11:49:00.944370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a28e3-6b1e-4112-89ce-59320ee19b4c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:00.944651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a28e3-6b1e-4112-89ce-59320ee19b4c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:00.945075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a28e3-6b1e-4112-89ce-59320ee19b4c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:00.946413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 527/1058] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:00.947114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a28e3-6b1e-4112-89ce-59320ee19b4c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:00.981653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e85cc5-20d8-400f-9e11-5bfd4f636c18 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:00.984064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.016404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.016610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.017629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.017935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.018209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.025976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.027417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-81d4576c-8b1e-4e92-b638-acc86864ce6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:49:01.039656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:01.041029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 532/1059] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:01.042107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.042888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.042888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.059838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a28e3-6b1e-4112-89ce-59320ee19b4c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.061391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:01.062657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:01.095085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.096234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.096516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.096791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.097960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.099391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.101039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 528/1060] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:00 2022] GET /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:01.101816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.136186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 533/1061] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:01.137177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.214974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabf5d-bed2-4b2a-a4d2-e5619752f245 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.244912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.252310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdf560-de75-4a86-9ff3-51522c391250 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.255189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.260606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.260606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.260606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.260606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:01.260606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.260606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.261024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.279850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 529/1062] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:01.285403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.290386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.291231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.291685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.292133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.293028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d, user.id=f5508e43101d41fb9bda7831a9b21ff4) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:01.293544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.295194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.301603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 534/1063] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/role_assignments?user.id=f5508e43101d41fb9bda7831a9b21ff4&scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:01.407196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36940f-6737-4bdb-aa63-d857631b35ea None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.407594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.460855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.461508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.461812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.462202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.473805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.475325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:01.492957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:01.494269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:01.495368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:01.495368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:01.495368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:01.497168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 530/1064] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:01.504059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.547326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443e645-0692-4bcc-9e58-64505c5f5378 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.562193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.589109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.589772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.590119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.590372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] PATH_INFO: `/v3/services/image` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.591002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.592445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:01.602563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:01.603613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:01.604454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 535/1065] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:01.609946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.630160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820330b-2863-43ae-ae8e-2626e2ae8095 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.639276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.668465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.669002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.669284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.669560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.670260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:01.670565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.672030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.685997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 531/1066] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:01.692061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.728262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e476bc6-0f80-47c3-ad3d-3de31da57070 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.768559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.769177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.769459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.769742 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.770399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:01.770706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.772064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.777006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 536/1067] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:01.783349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.820946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccf139-b750-42a7-bec6-ba151646d237 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.824115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.862498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.863471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.863940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.864216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.869790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:01.872841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.874330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:49:01.887101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:01.888222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:01.889268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:01.889787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a69a00-7408-4615-80f1-26bd4d5847c2 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:01.893876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 532/1068] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:01.899062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:01.929930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:01.930462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:01.930743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:01.931015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:01.931644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] RBAC: Adding query filter params (type=image) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:01.931943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:01.933301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:01.940003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 537/1069] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:01.945385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:02.012721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd5776-3789-4ced-bbb9-7905402ea16f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:02.049294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861e98-09af-49d5-bbdc-f2f691620b4a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:02.051211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:02.051821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:02.052096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:02.052370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:02.053058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:02.053361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:02.054828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:02.067319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 533/1070] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:49:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:02.073043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:02.095036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdfb54-6860-45eb-87a3-883497e8738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:02.095989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdfb54-6860-45eb-87a3-883497e8738e None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:02.096280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdfb54-6860-45eb-87a3-883497e8738e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:02.096545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdfb54-6860-45eb-87a3-883497e8738e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:02.097210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdfb54-6860-45eb-87a3-883497e8738e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:02.098989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdfb54-6860-45eb-87a3-883497e8738e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:02.103423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:02.161434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 538/1071] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:49:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:49:02.188333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19d61-74ef-4d69-bab2-e8f9f5e49743 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:02.233976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64e7c8-7d15-4c91-ad99-40dae1236b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:02.234958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64e7c8-7d15-4c91-ad99-40dae1236b6d None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:02.235415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64e7c8-7d15-4c91-ad99-40dae1236b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:02.236389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64e7c8-7d15-4c91-ad99-40dae1236b6d None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6384fbfdbff1461594e0e4f877bc8e5e/roles/28f19f9723304c71bfb5a84b4086f641` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:02.239020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64e7c8-7d15-4c91-ad99-40dae1236b6d None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6384fbfdbff1461594e0e4f877bc8e5e, role_id=28f19f9723304c71bfb5a84b4086f641)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:02.240721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64e7c8-7d15-4c91-ad99-40dae1236b6d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:02.318251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 534/1072] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:49:02 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6384fbfdbff1461594e0e4f877bc8e5e/roles/28f19f9723304c71bfb5a84b4086f641 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:49:03.498061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69bc41-4766-41dc-9636-0d5ca0f227c8 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:03.498595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69bc41-4766-41dc-9636-0d5ca0f227c8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:03.498595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69bc41-4766-41dc-9636-0d5ca0f227c8 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:03.499990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 539/1073] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:03.506135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:03.506561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:03.506726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:03.525553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:03.526768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:03.594299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 535/1074] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:03.867827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69bc41-4766-41dc-9636-0d5ca0f227c8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:03.878196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:03.974998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69bc41-4766-41dc-9636-0d5ca0f227c8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:04.010758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:04.011396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.011678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.011951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.022887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:04.027621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:04.028760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:04.029613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:04.034190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 540/1075] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:04.035194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:04.047015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:04.146474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adb14-26e4-4707-bc6e-b188489b7520 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:04.185644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:04.186320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.186601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.187042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.187544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:04.187850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:04.189725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd7a86-40f1-40ce-963d-89959d34329b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:04.202260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 536/1076] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:04.205777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:04.282346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:04.322866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4036-a914-4313-aaab-8cbf09d169a0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:04.364708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5b56-6ca1-476c-a494-98cbfabed33d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.364953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:04.365070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5b56-6ca1-476c-a494-98cbfabed33d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.365298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5b56-6ca1-476c-a494-98cbfabed33d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.365457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.365711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.366020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] PATH_INFO: `/v3/users/f5508e43101d41fb9bda7831a9b21ff4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.367030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 537/1077] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:49:04.367398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] RBAC: Authorizing `identity:get_user(user_id=f5508e43101d41fb9bda7831a9b21ff4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:04.368965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:04.370952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 541/1078] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:04 2022] GET /identity/v3/users/f5508e43101d41fb9bda7831a9b21ff4 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:04.372969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd42db-1211-4957-befb-5d07a62615ef None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.373261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd42db-1211-4957-befb-5d07a62615ef None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.373542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd42db-1211-4957-befb-5d07a62615ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.377939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:04.397666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8ddd42db-1211-4957-befb-5d07a62615ef None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:04.399026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8ddd42db-1211-4957-befb-5d07a62615ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:04.494206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 538/1079] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:04.495761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba338-52bb-4be5-9735-77ac273b7719 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.495875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba338-52bb-4be5-9735-77ac273b7719 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.496064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba338-52bb-4be5-9735-77ac273b7719 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.497976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 539/1080] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:04.502455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027233e-aa58-4de8-86df-9231b5e5f94f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:04.504458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.505596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.505914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.514617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:04.526650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:04.527854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:04.543938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:04.544820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.545280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.545792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.547687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] RBAC: Authorizing `identity:get_project(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:04.550275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:04.552848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 542/1081] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:04 2022] GET /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:04.558971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:04.561828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:04.634003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 540/1082] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:49:04.668530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bbab1-a657-4859-b046-63e6e882c22a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:04.702609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:04.703467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.703747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.704019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d/users/f5508e43101d41fb9bda7831a9b21ff4/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.705965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] RBAC: Authorizing `identity:create_grant(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d, user_id=f5508e43101d41fb9bda7831a9b21ff4, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:04.707398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:04.765842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:04.818838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 543/1083] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:49:04 2022] PUT /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d/users/f5508e43101d41fb9bda7831a9b21ff4/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:49:04.874035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecc44f-9daa-413d-800c-cd1cc12c1bc8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:04.908569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:04.908776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:04.914071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:04.914688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:04.915068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:04.915344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:04.980173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:04.997228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:04.998724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.027966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48b695-fd87-420c-aebc-74d57b84004a None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.067342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.067982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.068262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.068652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.080913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:05.086613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:05.087802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:05.089159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 544/1084] 10.222.0.47 () {56 vars in 1120 bytes} [Mon Oct 10 11:49:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:05.093706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.109425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 541/1085] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 11:49:05.115619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.150158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:05.205638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e066b81-d1d0-4818-979e-a9adc7a2abee None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.225630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5adc2-9233-4bea-a737-712b0832a254 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.228063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:05.247110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.247110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.247110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.247110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.247578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:05.247578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.247578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.255971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 545/1086] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:05.261812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.265409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.266329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.266795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.267250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.278396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.279859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:05.295624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:05.296629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:05.297531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:05.297531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:05.297531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:05.297531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 542/1087] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:05.303265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.371439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49173479-0a68-4e9d-9621-0db5c01ae3a1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.396349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:05.408305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.408993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.409267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.409546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.412671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bdad-8efa-481c-ac87-bfb646e27f8e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.419988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.421480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:05.436799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:05.437810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:05.439782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:05.439782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:05.439782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:05.439782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 546/1088] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:05.444525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.459096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.459096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.459096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.459366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.459990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:05.460353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.462081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.485991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 543/1089] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:05.488646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:05.564572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a58eb-a209-4c9e-a7c4-c42f7bccdc97 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.602700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.603331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.603623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.603899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.604563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:05.604867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.606314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.624731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 547/1090] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:05.626925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.741341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500609e-e00b-4c66-8f18-cfc951236688 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.780098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.780742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.781021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.781296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.789238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.790726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:49:05.802943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:05.804088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:05.805241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 544/1091] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:05.811839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.906691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:05.913269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca85e6-af24-4a56-bedd-23655db0a87e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:05.947678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:05.948285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:05.948564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:05.948839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:05.949564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:05.949892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:05.951313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:05.968795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 548/1092] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:05.975126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:05.979620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:06.075365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5188c-5823-4638-b2be-ea34267fde35 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:06.109164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:06.109765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.110073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.110347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:06.177195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:06.178586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:06.181181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:06.275486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 545/1093] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 11:49:06.281249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:06.380374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ac857-ed75-4b3e-b398-311d212f5624 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:06.414357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:06.415016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.415299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.415575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:06.427165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:06.428705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:06.445374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:06.446453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:06.447345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:06.447345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:06.447345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:06.447345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 549/1094] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:06.452400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:06.553726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed207fb-9af3-4b6b-a191-9b1cbf0c782c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:06.556178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:06.589088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:06.589688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.589997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.590267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:06.590914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:06.591212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:06.592569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:06.604830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 546/1095] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:06.610623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:06.620498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:06.712612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f10bb-e6e5-4620-9086-decfbffb2569 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:06.746569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:06.747198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.747483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.747762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:06.755284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:06.756723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:49:06.768506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:06.769366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:06.770361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 550/1096] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:49:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:06.775443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:06.877513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93474e7-a6a4-494a-bc71-dc56f40c830f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:06.914195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:06.914796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.915071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.915347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:06.916028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:06.916332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:06.917746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e0192-5af3-4860-8b73-3ab4df0aa80b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:06.930014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 547/1097] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:49:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:06.936015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:06.985362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3fd9e-60f4-4b8a-9614-a1103e166bcb None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.986113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3fd9e-60f4-4b8a-9614-a1103e166bcb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.986393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3fd9e-60f4-4b8a-9614-a1103e166bcb None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:06.987710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 548/1098] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:49:06.992867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:06.993147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:06.993411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:07.005243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:07.012350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:07.013559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:07.033044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:07.040629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96070ce8-4a7c-4c0d-a824-b677892768c1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:07.077171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:07.077781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:07.078084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:07.078360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:07.079074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] RBAC: Adding query filter params (role.id=28f19f9723304c71bfb5a84b4086f641, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6384fbfdbff1461594e0e4f877bc8e5e) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:07.079400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:07.080833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:07.085731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 549/1099] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:49:07.093909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 551/1100] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:06 2022] GET /identity/v3/role_assignments?user.id=6384fbfdbff1461594e0e4f877bc8e5e&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=28f19f9723304c71bfb5a84b4086f641 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:07.358062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:07.475061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ca4e2-1b9e-4334-8391-9a781d874469 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:07.511648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:07.512298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:07.512569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:07.512846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:07.526240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:07.531300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:07.532919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:07.534236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 550/1101] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:07.539500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:07.648304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148df34-b977-44dd-96eb-58329d6bc170 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:07.676917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:07.682778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:07.683396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:07.683673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:07.689818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:07.689818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:07.689818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:07.689818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:07.695356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 552/1102] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:07.701633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:07.719576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:07.806514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192e014-4dde-4098-bcb9-cbe76d6949a6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:07.841524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:07.842442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:07.842910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:07.843178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] PATH_INFO: `/v3/users/f5508e43101d41fb9bda7831a9b21ff4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:07.844337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] RBAC: Authorizing `identity:get_user(user_id=f5508e43101d41fb9bda7831a9b21ff4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:07.846438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:07.848190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 551/1103] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:07 2022] GET /identity/v3/users/f5508e43101d41fb9bda7831a9b21ff4 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:07.854194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:07.958660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf813f-7e2e-421f-96a9-029966468d43 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:07.993816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:07.994462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:07.994736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:07.995008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:08.052721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:08.061948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:08.063401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:08.159770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 553/1104] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:08.165721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:08.246875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:08.265249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98157730-89f4-48dd-ac32-20e5e5e1e223 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:08.299247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae8638-43f3-4cca-84c7-b5689cb498d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:08.299864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae8638-43f3-4cca-84c7-b5689cb498d9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:08.300139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae8638-43f3-4cca-84c7-b5689cb498d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:08.300409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae8638-43f3-4cca-84c7-b5689cb498d9 None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:08.301500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae8638-43f3-4cca-84c7-b5689cb498d9 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:08.302948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae8638-43f3-4cca-84c7-b5689cb498d9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:08.304552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 552/1105] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:08 2022] GET /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:08.310873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:08.399247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:08.408151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15a1b0-ec38-4868-84ca-5885a897ff63 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:08.440830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:08.441423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:08.441704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:08.442010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:08.442727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d, user.id=f5508e43101d41fb9bda7831a9b21ff4) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:08.443036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:08.444458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce8b44-b92b-41df-a96e-b32ddd8534d1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:08.450192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 554/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:08 2022] GET /identity/v3/role_assignments?user.id=f5508e43101d41fb9bda7831a9b21ff4&scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:10.594816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567e89-0aa9-42cd-9ea9-de71fe3fcfb8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:10.595337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567e89-0aa9-42cd-9ea9-de71fe3fcfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:10.595337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567e89-0aa9-42cd-9ea9-de71fe3fcfb8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:10.596785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 553/1107] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:10.602198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:10.602615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:10.602755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:10.621974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:10.623190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:10.690302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 555/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:10.966757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567e89-0aa9-42cd-9ea9-de71fe3fcfb8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:11.070213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567e89-0aa9-42cd-9ea9-de71fe3fcfb8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:11.103887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18fa4-76f1-4daa-b078-42fb68e2d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:11.104566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18fa4-76f1-4daa-b078-42fb68e2d8ff None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:11.104849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18fa4-76f1-4daa-b078-42fb68e2d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:11.105176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18fa4-76f1-4daa-b078-42fb68e2d8ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:11.106312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b18fa4-76f1-4daa-b078-42fb68e2d8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:11.107744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b18fa4-76f1-4daa-b078-42fb68e2d8ff None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:11.109340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 554/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:11.115807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:11.199213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:11.214777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0724fd6-3622-4c96-b71f-c49c0577d9e6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:11.248769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c1833-d724-4852-9eca-bf18629d8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:11.249299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c1833-d724-4852-9eca-bf18629d8aca None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:11.249579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c1833-d724-4852-9eca-bf18629d8aca None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:11.249868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c1833-d724-4852-9eca-bf18629d8aca None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:11.250507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c1833-d724-4852-9eca-bf18629d8aca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:11.252188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c1833-d724-4852-9eca-bf18629d8aca None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:11.352720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 556/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:49:11 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:49:13.525857 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb6b8-d089-4c40-a555-e3b2152ef6de None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:13.526392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb6b8-d089-4c40-a555-e3b2152ef6de None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:13.526503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fb6b8-d089-4c40-a555-e3b2152ef6de None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:13.527759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 555/1111] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:13.533167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:13.533617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:13.533719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:13.552436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:13.553646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:13.621797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 557/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:49:13.890711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb6b8-d089-4c40-a555-e3b2152ef6de None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:13.911665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:13.998874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fb6b8-d089-4c40-a555-e3b2152ef6de None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:14.034746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:14.035384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:14.035658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:14.035929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] PATH_INFO: `/v3/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:14.037365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] RBAC: Authorizing `identity:get_role(role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:14.038771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:14.040111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 556/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:13 2022] GET /identity/v3/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:14.046057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:14.114349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:14.143449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07be6d-f2fd-41f4-9dc7-fb629d775b4c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:14.177423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:14.178078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:14.178361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:14.178639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] PATH_INFO: `/v3/users/e4a14702fef1477b87ec997127b03d31` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:14.192394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a14702fef1477b87ec997127b03d31)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:14.193827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:14.195491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 558/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:14 2022] GET /identity/v3/users/e4a14702fef1477b87ec997127b03d31 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:14.201356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:14.284790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:14.298986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c6ee-6136-4c42-a7e4-dee7dffaeaec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:14.333483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:14.334104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:14.334382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:14.334648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:14.401737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:14.403124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:14.485177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:14.500744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 557/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:14.506757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:14.605696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049fe50-7060-46d8-a0b3-3a7d597c80e6 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:14.634300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:14.640108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813faf0-d180-41ea-87cc-549167714a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:14.640736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813faf0-d180-41ea-87cc-549167714a5a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:14.641017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813faf0-d180-41ea-87cc-549167714a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:14.641289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813faf0-d180-41ea-87cc-549167714a5a None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:14.643001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813faf0-d180-41ea-87cc-549167714a5a None admin] RBAC: Authorizing `identity:get_project(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:14.644417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813faf0-d180-41ea-87cc-549167714a5a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:14.646076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 559/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:14 2022] GET /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:14.652369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:14.751742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df90e9-5e53-4244-8dd0-d1d0d2cfff74 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:14.785541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:14.786169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:14.786449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:14.786720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:14.787433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] RBAC: Adding query filter params (role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d, user.id=e4a14702fef1477b87ec997127b03d31) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:14.787741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:14.789153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16195b9-80a0-4141-8134-a9e3815a1804 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:14.794423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 558/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:14 2022] GET /identity/v3/role_assignments?user.id=e4a14702fef1477b87ec997127b03d31&scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:16.932279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41720-5ab2-4824-905e-1fdb9428851a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:16.932816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41720-5ab2-4824-905e-1fdb9428851a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:16.932816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41720-5ab2-4824-905e-1fdb9428851a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:16.934113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 560/1118] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:16.939806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:16.940229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:16.940344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:16.959062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:16.960256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:17.006359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:17.026966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 559/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:17.295456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe41720-5ab2-4824-905e-1fdb9428851a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:17.399771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe41720-5ab2-4824-905e-1fdb9428851a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:17.433586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:17.434239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:17.434519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:17.434793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] PATH_INFO: `/v3/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:17.436176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] RBAC: Authorizing `identity:get_role(role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:17.437565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:17.439664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 561/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:17 2022] GET /identity/v3/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:17.445620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:17.543168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5f355-1151-40e1-9f7a-e8d6edcfb2d3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:17.576787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:17.577335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:17.577614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:17.577907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] PATH_INFO: `/v3/users/e4a14702fef1477b87ec997127b03d31` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:17.579539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a14702fef1477b87ec997127b03d31)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:17.580970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:17.582644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 560/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:17 2022] GET /identity/v3/users/e4a14702fef1477b87ec997127b03d31 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:17.588651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:17.654732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:17.687560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7759b11-687f-45f3-a80e-9d06e24a0e2f None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:17.721782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd74dc-1760-4c37-9a08-f35c29c6a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:17.722441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd74dc-1760-4c37-9a08-f35c29c6a790 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:17.722719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd74dc-1760-4c37-9a08-f35c29c6a790 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:17.722992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd74dc-1760-4c37-9a08-f35c29c6a790 None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:17.724097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd74dc-1760-4c37-9a08-f35c29c6a790 None admin] RBAC: Authorizing `identity:get_project(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:17.725527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd74dc-1760-4c37-9a08-f35c29c6a790 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:17.727197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 562/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:17 2022] GET /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:17.733405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:17.782200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:17.832150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917224b7-07a7-4f7e-b206-9278b7fefb75 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:17.865693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fadb91-3bab-42c3-a4b0-4ca1be7cb3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:17.866390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fadb91-3bab-42c3-a4b0-4ca1be7cb3fd None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:17.866670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fadb91-3bab-42c3-a4b0-4ca1be7cb3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:17.866945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fadb91-3bab-42c3-a4b0-4ca1be7cb3fd None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d/users/e4a14702fef1477b87ec997127b03d31/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:17.869069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fadb91-3bab-42c3-a4b0-4ca1be7cb3fd None admin] RBAC: Authorizing `identity:create_grant(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d, user_id=e4a14702fef1477b87ec997127b03d31, role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:17.870533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fadb91-3bab-42c3-a4b0-4ca1be7cb3fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:17.935651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 561/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:49:17 2022] PUT /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d/users/e4a14702fef1477b87ec997127b03d31/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:49:20.076947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab744c6c-0ec8-4531-b660-865e241791a0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:20.077486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab744c6c-0ec8-4531-b660-865e241791a0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:20.077486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab744c6c-0ec8-4531-b660-865e241791a0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:20.078878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 563/1124] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:20.084150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:20.084601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:20.084695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:20.103969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:20.105166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:20.171303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 562/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:20.439717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab744c6c-0ec8-4531-b660-865e241791a0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:20.549398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab744c6c-0ec8-4531-b660-865e241791a0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:20.584819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:20.585453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:20.585736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:20.586044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] PATH_INFO: `/v3/roles/2e0b13a5812e4d5c922b9cd2ce75677a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:20.587565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] RBAC: Authorizing `identity:get_role(role_id=2e0b13a5812e4d5c922b9cd2ce75677a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:20.588932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:20.590309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 564/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:20 2022] GET /identity/v3/roles/2e0b13a5812e4d5c922b9cd2ce75677a => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:20.596989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:20.635401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:20.693554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d417f-b2c0-4173-8ab2-18cec65f73ba None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:20.731138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:20.731769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:20.732045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:20.732314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] PATH_INFO: `/v3/users/e4a14702fef1477b87ec997127b03d31` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:20.733490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a14702fef1477b87ec997127b03d31)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:20.735019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:20.736637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 563/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:20 2022] GET /identity/v3/users/e4a14702fef1477b87ec997127b03d31 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:20.742682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:20.745689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:20.848953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5dbb6-f2a3-4227-9717-b213fb930241 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:20.882952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:20.883556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:20.883836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:20.884111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:20.952235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:20.953694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:20.956106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:21.055686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 565/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:21.062524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:21.167558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092a7a-c20a-43ff-9e8d-b25afc5a2122 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:21.175813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:21.204832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e38f91-423a-4d36-9bbd-87539b39e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:21.205377 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38f91-423a-4d36-9bbd-87539b39e55b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:21.205660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38f91-423a-4d36-9bbd-87539b39e55b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:21.205968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38f91-423a-4d36-9bbd-87539b39e55b None admin] PATH_INFO: `/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:21.207170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e38f91-423a-4d36-9bbd-87539b39e55b None admin] RBAC: Authorizing `identity:get_project(project_id=9e7f3bf1a6794b5eaf2950c4db154e9d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:21.208589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e38f91-423a-4d36-9bbd-87539b39e55b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:21.210251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 564/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:21 2022] GET /identity/v3/projects/9e7f3bf1a6794b5eaf2950c4db154e9d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:21.216574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:21.315648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ce9cc-afda-4dda-800b-d4de45877707 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:21.317178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:21.350118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:21.350736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:21.351021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:21.351298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:21.352026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] RBAC: Adding query filter params (role.id=2e0b13a5812e4d5c922b9cd2ce75677a, scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d, user.id=e4a14702fef1477b87ec997127b03d31) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:21.352338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:21.353769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059ac6e-4ea9-4d29-82da-d42ab5b35754 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:21.360540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 566/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:21 2022] GET /identity/v3/role_assignments?user.id=e4a14702fef1477b87ec997127b03d31&scope.project.id=9e7f3bf1a6794b5eaf2950c4db154e9d&role.id=2e0b13a5812e4d5c922b9cd2ce75677a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:23.548766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e04fb2-6988-4cab-ad88-33c12c9cd299 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:23.549338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e04fb2-6988-4cab-ad88-33c12c9cd299 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:23.549338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e04fb2-6988-4cab-ad88-33c12c9cd299 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:23.550859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 565/1131] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:23.557026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:23.557542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:23.557542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:23.578189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:23.579483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:23.653273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 567/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:23.920385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e04fb2-6988-4cab-ad88-33c12c9cd299 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:24.021170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e04fb2-6988-4cab-ad88-33c12c9cd299 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:24.055172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a5129-44bf-4612-a331-26a25fe81584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:24.055802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5129-44bf-4612-a331-26a25fe81584 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:24.056085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5129-44bf-4612-a331-26a25fe81584 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:24.056359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a5129-44bf-4612-a331-26a25fe81584 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:24.057501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a5129-44bf-4612-a331-26a25fe81584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:24.058965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a5129-44bf-4612-a331-26a25fe81584 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:24.060537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 566/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:24.066490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:24.158902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:24.164493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9bb91-4c71-4409-a5ac-1e96a0ade848 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:24.198236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1f876-ecae-40f0-814d-634f5b401ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:24.198849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1f876-ecae-40f0-814d-634f5b401ac6 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:24.199127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1f876-ecae-40f0-814d-634f5b401ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:24.199398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1f876-ecae-40f0-814d-634f5b401ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:24.200044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1f876-ecae-40f0-814d-634f5b401ac6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:24.201520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1f876-ecae-40f0-814d-634f5b401ac6 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:24.286234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 568/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:49:24 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:49:26.523627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f753ed-ca0b-4e27-bc0a-50abc8d46c79 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:26.524148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f753ed-ca0b-4e27-bc0a-50abc8d46c79 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:26.524148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f753ed-ca0b-4e27-bc0a-50abc8d46c79 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:26.525502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 567/1135] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:26.530924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:26.531406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:26.532088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:26.550412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:26.551730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:26.618358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 569/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:26.894670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f753ed-ca0b-4e27-bc0a-50abc8d46c79 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:26.938396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:26.998500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f753ed-ca0b-4e27-bc0a-50abc8d46c79 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:27.035704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34463c-1677-4192-b071-91bd70296eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:27.036330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34463c-1677-4192-b071-91bd70296eba None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:27.036602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34463c-1677-4192-b071-91bd70296eba None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:27.036870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34463c-1677-4192-b071-91bd70296eba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:27.037997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34463c-1677-4192-b071-91bd70296eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:27.039419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34463c-1677-4192-b071-91bd70296eba None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:27.040982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 568/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:27.046825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:27.124512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:27.146845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14832897-2140-4b3f-a81d-b01651f43e36 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:27.182091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a510c5-30b8-4ea2-8c1f-9b5c91fd4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:27.182701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a510c5-30b8-4ea2-8c1f-9b5c91fd4972 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:27.182987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a510c5-30b8-4ea2-8c1f-9b5c91fd4972 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:27.183312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a510c5-30b8-4ea2-8c1f-9b5c91fd4972 None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:27.183973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a510c5-30b8-4ea2-8c1f-9b5c91fd4972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:27.185403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a510c5-30b8-4ea2-8c1f-9b5c91fd4972 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:27.278217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 570/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:49:27 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:49:29.513320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6670-c158-4853-9850-e98d04d9973f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:29.513899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6670-c158-4853-9850-e98d04d9973f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:29.513899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6670-c158-4853-9850-e98d04d9973f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:29.515201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 569/1139] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:29.520458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d615561-03fc-4402-af96-eafeb047541c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:29.520890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d615561-03fc-4402-af96-eafeb047541c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:29.521017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d615561-03fc-4402-af96-eafeb047541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:29.538887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0d615561-03fc-4402-af96-eafeb047541c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:29.540078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0d615561-03fc-4402-af96-eafeb047541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:29.607548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 571/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:29.888099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6670-c158-4853-9850-e98d04d9973f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:29.987121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6670-c158-4853-9850-e98d04d9973f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:29.997754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:30.020791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:30.021411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:30.021689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:30.021987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:30.032734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:30.037829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:30.039085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:30.040134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 570/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:30.045254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d615561-03fc-4402-af96-eafeb047541c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:30.106748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:30.146988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d615561-03fc-4402-af96-eafeb047541c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:30.184438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:30.185050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:30.185393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:30.185610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:30.186309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:30.186615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:30.188028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:30.196987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 572/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:30.203017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:30.303447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e211-63f2-4a50-b0b2-eec325080207 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:30.336255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:30.336881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:30.337153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:30.337420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] PATH_INFO: `/v3/users/5f780885c6f34b09a07816467ce70823` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:30.351187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] RBAC: Authorizing `identity:get_user(user_id=5f780885c6f34b09a07816467ce70823)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:30.352611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:30.354265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 571/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:30 2022] GET /identity/v3/users/5f780885c6f34b09a07816467ce70823 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:30.360256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:30.460838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f582f43-9657-4108-afe5-42ab5790c787 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:30.488079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:30.496571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:30.497181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:30.497464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:30.497739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:30.568864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:30.570657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:30.667945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 573/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:30.674029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:30.702379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:30.774980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70f51-5183-4e5d-b514-0c777583e6ae None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:30.813210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19ad78-a790-404a-816b-65bd6ac7f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:30.813944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ad78-a790-404a-816b-65bd6ac7f31f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:30.816259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ad78-a790-404a-816b-65bd6ac7f31f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:30.816259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19ad78-a790-404a-816b-65bd6ac7f31f None admin] PATH_INFO: `/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:30.816259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ad78-a790-404a-816b-65bd6ac7f31f None admin] RBAC: Authorizing `identity:get_project(project_id=606535e11cba42ffa1e8e5daf5d6e08f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:30.817215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19ad78-a790-404a-816b-65bd6ac7f31f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:30.819033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 572/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:30 2022] GET /identity/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:30.825587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:30.854483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:30.935975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540cea-d84e-4261-9aea-03f0111aea31 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:30.974447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:30.975368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:30.975655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:30.975931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:30.976662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=606535e11cba42ffa1e8e5daf5d6e08f, user.id=5f780885c6f34b09a07816467ce70823) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:30.976974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:30.978459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130e27f-efa1-496e-bc52-ed7c7cf9c553 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:30.984686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 574/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:30 2022] GET /identity/v3/role_assignments?user.id=5f780885c6f34b09a07816467ce70823&scope.project.id=606535e11cba42ffa1e8e5daf5d6e08f&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:33.118118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238dc18-7445-4c33-ac93-175bc85e6857 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:33.118728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238dc18-7445-4c33-ac93-175bc85e6857 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:33.118728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238dc18-7445-4c33-ac93-175bc85e6857 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:33.119983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 573/1147] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:33.125393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:33.125812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:33.125966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:33.144164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:33.145340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:33.211212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 575/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:49:33.480079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238dc18-7445-4c33-ac93-175bc85e6857 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:33.573720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:33.581078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238dc18-7445-4c33-ac93-175bc85e6857 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:33.614526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:33.615194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:33.615472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:33.615742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:33.626259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:33.630944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:33.631989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:33.632975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 574/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:33.638184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:33.659746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:33.737612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421d247-e3e1-4aed-ab5b-b23a2a55d2af None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:33.771421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:33.772025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:33.772305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:33.772576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:33.773233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:33.773534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:33.774962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:33.783136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 576/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:33.789132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:33.888294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c0ff-db40-4cc3-81c3-4dc1e106e9a7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:33.920631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:33.921251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:33.921526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:33.922352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] PATH_INFO: `/v3/users/5f780885c6f34b09a07816467ce70823` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:33.923462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] RBAC: Authorizing `identity:get_user(user_id=5f780885c6f34b09a07816467ce70823)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:33.924880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:33.926487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 575/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:33 2022] GET /identity/v3/users/5f780885c6f34b09a07816467ce70823 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:33.932337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:34.020025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:34.038448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bfc42-80db-4738-8284-1ea1fdb05a85 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:34.075499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ece72-53e1-4dab-b6e6-93caa22b3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:34.076142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ece72-53e1-4dab-b6e6-93caa22b3763 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:34.076421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ece72-53e1-4dab-b6e6-93caa22b3763 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:34.076698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ece72-53e1-4dab-b6e6-93caa22b3763 None admin] PATH_INFO: `/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:34.077898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ece72-53e1-4dab-b6e6-93caa22b3763 None admin] RBAC: Authorizing `identity:get_project(project_id=606535e11cba42ffa1e8e5daf5d6e08f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:34.079383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ece72-53e1-4dab-b6e6-93caa22b3763 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:34.081069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 577/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:33 2022] GET /identity/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:34.087419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:34.116438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:34.194577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef448-d854-4a0d-baaf-95fbf2d782fe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:34.230194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a72650-d307-4a6a-a722-a1cdc1173946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:34.230890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a72650-d307-4a6a-a722-a1cdc1173946 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:34.231168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a72650-d307-4a6a-a722-a1cdc1173946 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:34.231442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a72650-d307-4a6a-a722-a1cdc1173946 None admin] PATH_INFO: `/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f/users/5f780885c6f34b09a07816467ce70823/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:34.233383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a72650-d307-4a6a-a722-a1cdc1173946 None admin] RBAC: Authorizing `identity:create_grant(project_id=606535e11cba42ffa1e8e5daf5d6e08f, user_id=5f780885c6f34b09a07816467ce70823, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:34.235450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a72650-d307-4a6a-a722-a1cdc1173946 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:34.318691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 576/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:49:34 2022] PUT /identity/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f/users/5f780885c6f34b09a07816467ce70823/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:49:36.476640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b276bf-6417-42ec-b00f-5d880948fb3c None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:36.477185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b276bf-6417-42ec-b00f-5d880948fb3c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:36.477185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b276bf-6417-42ec-b00f-5d880948fb3c None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:36.478588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 578/1154] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:36.484811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:36.485327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:36.485440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:36.506388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:36.507571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:36.574767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 577/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:36.848735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b276bf-6417-42ec-b00f-5d880948fb3c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:36.949238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b276bf-6417-42ec-b00f-5d880948fb3c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:36.982225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:36.982846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:36.983125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:36.983399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:36.993820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:36.998512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:36.999656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:37.000965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 579/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:37.006141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:37.021106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:37.104431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14402a5b-db75-4bc0-9c15-1b9994c559c2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:37.142894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:37.143533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:37.143796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:37.144061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:37.144734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:37.145033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:37.146456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:37.155768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 578/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:37.162701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:37.176560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:37.269723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ceedc-0cbd-484e-ae3c-c956eec2aafa None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:37.306284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:37.306923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:37.307247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:37.307473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] PATH_INFO: `/v3/users/5f780885c6f34b09a07816467ce70823` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:37.308605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] RBAC: Authorizing `identity:get_user(user_id=5f780885c6f34b09a07816467ce70823)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:37.310072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:37.311691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 580/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:37 2022] GET /identity/v3/users/5f780885c6f34b09a07816467ce70823 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:37.317742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:37.400120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:37.422404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f95a0-a4f1-4340-8373-b9a4fe7a8ac8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:37.456721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:37.457343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:37.457628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:37.457932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:37.527292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:37.528738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:37.603869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:37.627969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 579/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:37.634087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:37.712321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:37.732953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaf251-978a-4938-a8bf-502507fe2e17 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:37.767554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e5629-44c0-41cd-adda-cfcfd11bed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:37.768188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5629-44c0-41cd-adda-cfcfd11bed1a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:37.768472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5629-44c0-41cd-adda-cfcfd11bed1a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:37.768747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e5629-44c0-41cd-adda-cfcfd11bed1a None admin] PATH_INFO: `/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:37.769892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5629-44c0-41cd-adda-cfcfd11bed1a None admin] RBAC: Authorizing `identity:get_project(project_id=606535e11cba42ffa1e8e5daf5d6e08f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:37.771330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e5629-44c0-41cd-adda-cfcfd11bed1a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:37.773051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 581/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:37 2022] GET /identity/v3/projects/606535e11cba42ffa1e8e5daf5d6e08f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:37.779250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:37.878865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657d6c-bf3b-478e-8fb5-65bbfef985c1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:37.912401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:37.912998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:37.913274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:37.913544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:37.914297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=606535e11cba42ffa1e8e5daf5d6e08f, user.id=5f780885c6f34b09a07816467ce70823) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:37.914601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:37.916014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d4960-3698-416c-8a51-bcf4902a96c7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:37.922305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 580/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:37 2022] GET /identity/v3/role_assignments?user.id=5f780885c6f34b09a07816467ce70823&scope.project.id=606535e11cba42ffa1e8e5daf5d6e08f&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:40.062338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dde5f-39a8-4f56-8fc6-63d7c48e65dd None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:40.062869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dde5f-39a8-4f56-8fc6-63d7c48e65dd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:40.062869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dde5f-39a8-4f56-8fc6-63d7c48e65dd None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:40.064202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 582/1162] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:40.069692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:40.070131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:40.070282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:40.088910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:40.090121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:40.124152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:40.156692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 581/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:40.432277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dde5f-39a8-4f56-8fc6-63d7c48e65dd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:40.548155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dde5f-39a8-4f56-8fc6-63d7c48e65dd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:40.582810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:40.583410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:40.583692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:40.583966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:40.599114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:40.651603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:40.653040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:40.752242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 583/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:40.758251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:40.854732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b51a3-05b1-4104-bfc1-eb754c1eed6b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:40.888518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:40.889142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:40.889422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:40.889697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:40.896347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:40.897781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-86e56f85-1970-429c-8eb2-2fd3a0aecc1b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:40.909439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:40.910722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:40.911769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 582/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:49:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:40.916540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:40.961480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:41.015139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5f145-4176-4f93-9e17-25053b8567bb None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:41.049628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:41.050255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:41.050531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:41.050800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:41.051431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:41.051733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:41.053075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b4201-0c0e-47ff-ab50-486c6eaa9099 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:41.060221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 584/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Mon Oct 10 11:49:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:43.202967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d67280-a1ec-48f4-b070-f51685f806fd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:43.203565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d67280-a1ec-48f4-b070-f51685f806fd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:43.203565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d67280-a1ec-48f4-b070-f51685f806fd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:43.205500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 583/1167] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:43.211189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc2cb-40c6-47ef-a01a-2807c43482db None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:43.211622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc2cb-40c6-47ef-a01a-2807c43482db None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:43.211725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc2cb-40c6-47ef-a01a-2807c43482db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:43.229455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-66abc2cb-40c6-47ef-a01a-2807c43482db None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:43.230691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-66abc2cb-40c6-47ef-a01a-2807c43482db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:43.295441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 585/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:43.561099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d67280-a1ec-48f4-b070-f51685f806fd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:43.594073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:43.667658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d67280-a1ec-48f4-b070-f51685f806fd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:43.700343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e1ead-add4-41d6-9040-a6aa5be87fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:43.700938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1ead-add4-41d6-9040-a6aa5be87fe6 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:43.701272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1ead-add4-41d6-9040-a6aa5be87fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:43.701543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1ead-add4-41d6-9040-a6aa5be87fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:43.702223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e1ead-add4-41d6-9040-a6aa5be87fe6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:43.704110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e1ead-add4-41d6-9040-a6aa5be87fe6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:43.826160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 584/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Mon Oct 10 11:49:43 2022] POST /identity/v3/domains => generated 267 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:49:46.015785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbffa5-f5c9-4a79-944d-6d2987a1e0a0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:46.016340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbffa5-f5c9-4a79-944d-6d2987a1e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:46.016340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbffa5-f5c9-4a79-944d-6d2987a1e0a0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:46.017660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 586/1170] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:46.022970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef688e8-72ec-4309-96a6-837997101248 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:46.023371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef688e8-72ec-4309-96a6-837997101248 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:46.023506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef688e8-72ec-4309-96a6-837997101248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:46.041932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cef688e8-72ec-4309-96a6-837997101248 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:46.043101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cef688e8-72ec-4309-96a6-837997101248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:46.111469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 585/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:46.387882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbffa5-f5c9-4a79-944d-6d2987a1e0a0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:46.429973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:46.488813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbffa5-f5c9-4a79-944d-6d2987a1e0a0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:46.523218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e1f8d-0a39-4d2b-b0cd-e1b4aea8dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:46.523852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1f8d-0a39-4d2b-b0cd-e1b4aea8dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:46.524132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1f8d-0a39-4d2b-b0cd-e1b4aea8dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:46.524402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e1f8d-0a39-4d2b-b0cd-e1b4aea8dcb4 None admin] PATH_INFO: `/v3/domains/ccd37fbefcf84bc18b7f237f2f7243ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:46.540501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e1f8d-0a39-4d2b-b0cd-e1b4aea8dcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ccd37fbefcf84bc18b7f237f2f7243ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:46.541989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e1f8d-0a39-4d2b-b0cd-e1b4aea8dcb4 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:46.543658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 587/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Mon Oct 10 11:49:46 2022] GET /identity/v3/domains/ccd37fbefcf84bc18b7f237f2f7243ba => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:46.550232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef688e8-72ec-4309-96a6-837997101248 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:46.571767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:46.655230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef688e8-72ec-4309-96a6-837997101248 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:46.693339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee2822-68eb-4217-b009-5905e5e4c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:46.694137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee2822-68eb-4217-b009-5905e5e4c79f None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:46.694432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee2822-68eb-4217-b009-5905e5e4c79f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:46.694700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee2822-68eb-4217-b009-5905e5e4c79f None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:46.695354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee2822-68eb-4217-b009-5905e5e4c79f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:46.696782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee2822-68eb-4217-b009-5905e5e4c79f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:46.782136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 586/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:49:46 2022] POST /identity/v3/projects => generated 361 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:49:48.995499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad688e5-db70-410d-a9a9-0d200d7be520 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:48.996047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad688e5-db70-410d-a9a9-0d200d7be520 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:48.996047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad688e5-db70-410d-a9a9-0d200d7be520 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:48.997395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 588/1174] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:49.002987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:49.003413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:49.003543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:49.021950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:49.023137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:49.089204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 587/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:49.357328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad688e5-db70-410d-a9a9-0d200d7be520 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:49.462268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:49.466226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad688e5-db70-410d-a9a9-0d200d7be520 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:49.503422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066113e2-bd02-4c17-b11a-6ad39616eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:49.504049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066113e2-bd02-4c17-b11a-6ad39616eb29 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:49.504330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066113e2-bd02-4c17-b11a-6ad39616eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:49.504608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066113e2-bd02-4c17-b11a-6ad39616eb29 None admin] PATH_INFO: `/v3/domains/ccd37fbefcf84bc18b7f237f2f7243ba` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:49.505891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066113e2-bd02-4c17-b11a-6ad39616eb29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ccd37fbefcf84bc18b7f237f2f7243ba)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:49.507333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066113e2-bd02-4c17-b11a-6ad39616eb29 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:49.508924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 589/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Mon Oct 10 11:49:49 2022] GET /identity/v3/domains/ccd37fbefcf84bc18b7f237f2f7243ba => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:49.514733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:49.516950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:49.614530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef9ab1-237d-4a29-831b-b2afc8cc59ad None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:49.648949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3e587-35ec-433a-aac8-52d8757a9955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:49.649550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e587-35ec-433a-aac8-52d8757a9955 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:49.649830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e587-35ec-433a-aac8-52d8757a9955 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:49.650136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3e587-35ec-433a-aac8-52d8757a9955 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:49.650784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3e587-35ec-433a-aac8-52d8757a9955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:49.652202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3e587-35ec-433a-aac8-52d8757a9955 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:49.790469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 588/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:49:49 2022] POST /identity/v3/users => generated 311 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:49:52.009542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ae8c-3733-4362-8d85-a93449f83998 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.010270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ae8c-3733-4362-8d85-a93449f83998 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.010270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ae8c-3733-4362-8d85-a93449f83998 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.011485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 590/1178] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:52.017114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.017571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.017661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.035711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:52.036896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:52.090371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:52.104251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 589/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:52.374315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427ae8c-3733-4362-8d85-a93449f83998 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.474846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427ae8c-3733-4362-8d85-a93449f83998 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.511143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.511790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.512093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.512363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.524835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:52.529586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:52.531350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:52.532445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 591/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:52.537391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.635365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7af7-fbb7-48eb-bc3e-6f8f7a25d3cd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.670510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.671157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.671433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.671707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.672365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:52.672666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:52.674058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:52.682656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 590/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:52.689177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.723366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:52.801715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b9aca-3a90-4423-a3e6-948dbd7a601b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.838343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.838990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.839267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.839538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] PATH_INFO: `/v3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.854606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] RBAC: Authorizing `identity:get_user(user_id=2afebfb549fa4fa59c3e2c0ff4d19ea9)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:52.856057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:52.857768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 592/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:52.863753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.913925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:52.963899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4f4d-c2ac-46d4-9446-452b9dc1e30b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.996538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.997139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.997421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.997697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.065336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.066826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.115885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:53.167158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 591/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:53.173253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:53.257185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:53.271339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f58993-ad68-4f92-91b6-6148e531a53b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:53.305314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce6c0e-9666-4602-9655-1cedeecf9723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:53.305965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6c0e-9666-4602-9655-1cedeecf9723 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:53.306247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6c0e-9666-4602-9655-1cedeecf9723 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:53.306523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6c0e-9666-4602-9655-1cedeecf9723 None admin] PATH_INFO: `/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.307632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce6c0e-9666-4602-9655-1cedeecf9723 None admin] RBAC: Authorizing `identity:get_project(project_id=f7b4cd9a7670468cb33e558599c4a0d3)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.309104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce6c0e-9666-4602-9655-1cedeecf9723 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.310777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 593/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:53 2022] GET /identity/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:53.317843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:53.416283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f339c-9d20-47f4-b5f2-bb7c4e7bd997 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:53.452049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:53.452673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:53.452943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:53.453213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.453959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=f7b4cd9a7670468cb33e558599c4a0d3, user.id=2afebfb549fa4fa59c3e2c0ff4d19ea9) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:53.454269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.455693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128a4f8-9347-4e85-9d22-9d03b565ab06 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.461441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 592/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:53 2022] GET /identity/v3/role_assignments?user.id=2afebfb549fa4fa59c3e2c0ff4d19ea9&scope.project.id=f7b4cd9a7670468cb33e558599c4a0d3&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:55.618479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25899f-ab33-4aeb-9a67-2f5b12ae4ede None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:55.619039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25899f-ab33-4aeb-9a67-2f5b12ae4ede None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:55.619127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25899f-ab33-4aeb-9a67-2f5b12ae4ede None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:55.620439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 594/1186] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:55.626125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:55.626528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:55.626678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:55.645217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:55.646582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:55.656709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:55.723537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 593/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:55.995306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25899f-ab33-4aeb-9a67-2f5b12ae4ede None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.104120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25899f-ab33-4aeb-9a67-2f5b12ae4ede None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.140537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.141212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.141522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.141807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.153785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:56.158642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:56.159759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:49:56.160600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 595/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:56.166067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.277369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba01201-c277-47c4-a273-178baa3a0f3b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.313279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.313905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.314190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.314464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.315133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:56.315435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:56.316806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:56.325361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 594/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:56.331502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.347870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:56.438944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f6512-2c82-4833-82c0-92bc52301482 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.476434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.477071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.477347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.477619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] PATH_INFO: `/v3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.478776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] RBAC: Authorizing `identity:get_user(user_id=2afebfb549fa4fa59c3e2c0ff4d19ea9)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:56.480285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:56.481893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 596/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:56.488664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.498249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:56.594964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19090e-bff0-4fb0-8177-c20a9a3fdae6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.629585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f15b1-95a4-49be-bc46-89c05a7b0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.630331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f15b1-95a4-49be-bc46-89c05a7b0697 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.630501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f15b1-95a4-49be-bc46-89c05a7b0697 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.630770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f15b1-95a4-49be-bc46-89c05a7b0697 None admin] PATH_INFO: `/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.631901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f15b1-95a4-49be-bc46-89c05a7b0697 None admin] RBAC: Authorizing `identity:get_project(project_id=f7b4cd9a7670468cb33e558599c4a0d3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:56.633319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f15b1-95a4-49be-bc46-89c05a7b0697 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:56.634981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 595/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:49:56.641235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.726968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:56.745636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09083bf-874f-4edc-82fe-dcd37f240db9 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.783396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad03e2-14ae-443c-ab7e-dbbe558cb925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.784048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad03e2-14ae-443c-ab7e-dbbe558cb925 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.784325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad03e2-14ae-443c-ab7e-dbbe558cb925 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.784596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad03e2-14ae-443c-ab7e-dbbe558cb925 None admin] PATH_INFO: `/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.786496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad03e2-14ae-443c-ab7e-dbbe558cb925 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7b4cd9a7670468cb33e558599c4a0d3, user_id=2afebfb549fa4fa59c3e2c0ff4d19ea9, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:56.787930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad03e2-14ae-443c-ab7e-dbbe558cb925 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:56.855608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 597/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:49:56 2022] PUT /identity/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:49:59.018831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1afcf-08ab-4329-8b5f-6c5ed92a1e7c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:59.019441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1afcf-08ab-4329-8b5f-6c5ed92a1e7c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:59.019551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1afcf-08ab-4329-8b5f-6c5ed92a1e7c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:59.020990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 596/1193] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:59.026399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:59.026800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:59.026935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:59.044707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:59.045919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:59.112150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 598/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:59.376983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1afcf-08ab-4329-8b5f-6c5ed92a1e7c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:59.454874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:59.481288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1afcf-08ab-4329-8b5f-6c5ed92a1e7c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:59.516860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:59.517481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:59.517755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:59.518056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:59.528454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:59.533671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:59.534908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:49:59.536040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 597/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:59.540899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:59.608988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:59.638310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0bef-9b0c-4b74-9d58-1c20e82481da None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:59.672801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:59.673426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:59.673707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:59.674016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:59.674695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:59.675002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:59.676403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:59.688928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 599/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:49:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:59.695778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:59.797915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057339-b8fe-4f1a-84e8-7a4d2c51e411 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:59.832210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:59.832834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:59.833111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:59.833381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] PATH_INFO: `/v3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:59.834509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] RBAC: Authorizing `identity:get_user(user_id=2afebfb549fa4fa59c3e2c0ff4d19ea9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:59.835937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:59.837617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 598/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Oct 10 11:49:59 2022] GET /identity/v3/users/2afebfb549fa4fa59c3e2c0ff4d19ea9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:59.844049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:59.943433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2f51-6d57-44dd-acc5-b53e20ccbf2c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:59.978037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:59.978648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:59.978932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:59.979309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:59.981829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:00.047525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:00.048972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:00.148356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 600/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:50:00.154445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:00.157879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:00.258301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74830353-6d0d-42a2-96ae-68dfe71225fd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:00.293839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047e7c-b3ce-4a99-b03f-02f6ede29dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:00.294682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047e7c-b3ce-4a99-b03f-02f6ede29dec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:00.295200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047e7c-b3ce-4a99-b03f-02f6ede29dec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:00.295502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047e7c-b3ce-4a99-b03f-02f6ede29dec None admin] PATH_INFO: `/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:00.296762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2047e7c-b3ce-4a99-b03f-02f6ede29dec None admin] RBAC: Authorizing `identity:get_project(project_id=f7b4cd9a7670468cb33e558599c4a0d3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:00.298338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2047e7c-b3ce-4a99-b03f-02f6ede29dec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:00.299979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 599/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Oct 10 11:50:00 2022] GET /identity/v3/projects/f7b4cd9a7670468cb33e558599c4a0d3 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:00.306276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:00.343493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:00.411014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2a681-f8ff-439e-a42f-0a2ec05d59ae None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:00.444841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:00.445459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:00.445738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:00.446041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:00.446757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=f7b4cd9a7670468cb33e558599c4a0d3, user.id=2afebfb549fa4fa59c3e2c0ff4d19ea9) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:00.447065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:00.448522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b771258-6e0f-4f31-aa20-3e20b204e5e5 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:00.455979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 601/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:50:00 2022] GET /identity/v3/role_assignments?user.id=2afebfb549fa4fa59c3e2c0ff4d19ea9&scope.project.id=f7b4cd9a7670468cb33e558599c4a0d3&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:10.287999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=65 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:10.453728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=51 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:19.789546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84e3d-6c0d-4c9d-9dfd-6a4e02ce9b51 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:19.790157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84e3d-6c0d-4c9d-9dfd-6a4e02ce9b51 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:19.790157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d84e3d-6c0d-4c9d-9dfd-6a4e02ce9b51 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:19.791397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 600/1201] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:19.797303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:19.797726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:19.797866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:19.817536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:19.818771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:19.886667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 602/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:51:20.160414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84e3d-6c0d-4c9d-9dfd-6a4e02ce9b51 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:20.261955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d84e3d-6c0d-4c9d-9dfd-6a4e02ce9b51 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:20.295343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:20.295956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:20.296235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:20.296504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:20.307020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:20.309030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:20.323150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:20.324382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:20.325396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:20.325396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:20.325396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:20.325396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 601/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:20.330426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:20.429029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e646-504e-4bc4-8c16-9ef9cb13b485 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:20.456731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:20.462659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:20.463352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:20.463583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:20.463852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:20.464480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:20.464799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:20.466188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ab16b-bc83-4e4d-928b-bee210d5a475 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:20.477427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 603/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:20.483907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:20.537083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:20.582974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f28f6c-c55e-4c39-86e6-54655074d755 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:20.615651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e42e2-4da0-44d4-a32d-f1f30aa41882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:20.616246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e42e2-4da0-44d4-a32d-f1f30aa41882 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:20.616523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e42e2-4da0-44d4-a32d-f1f30aa41882 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:20.616797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e42e2-4da0-44d4-a32d-f1f30aa41882 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:20.617430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e42e2-4da0-44d4-a32d-f1f30aa41882 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:20.618879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e42e2-4da0-44d4-a32d-f1f30aa41882 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:20.744233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 602/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Oct 10 11:51:20 2022] POST /identity/v3/users => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:51:22.943040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c745-b0bd-468a-9736-5bc2939a8dcd None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:22.943577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c745-b0bd-468a-9736-5bc2939a8dcd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:22.943670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c745-b0bd-468a-9736-5bc2939a8dcd None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:22.944963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 604/1206] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:22.951016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:22.951445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:22.951575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:22.969514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:22.970730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:23.038104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 603/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:51:23.312073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c745-b0bd-468a-9736-5bc2939a8dcd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:23.413259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c745-b0bd-468a-9736-5bc2939a8dcd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:23.447339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:23.447970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:23.448245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:23.448512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:23.459605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:51:23.464323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:23.465505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:23.466559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 605/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:51:23.473802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:23.514904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:23.576512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0f171-684b-4bff-90bc-ccc6c2d4ba7e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:23.610685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:23.611283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:23.611558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:23.611831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:23.612485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:23.612787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:23.614174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:23.622986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 604/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:23.629085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:23.678126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:23.727001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109e0dc-0af3-44f7-a23a-98ea9f8b0e5b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:23.759924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:23.760542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:23.760820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:23.761092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:23.771225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:23.772715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:23.787723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:23.791223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:23.792328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:23.792328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:23.792328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:23.792328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 606/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:23.795366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:23.891899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:23.894755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f653a-7a23-44ec-9185-49e46d167c3c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:23.928252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:23.928854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:23.929132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:23.929405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:23.930066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:23.930367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:23.931815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:23.943434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 605/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:23.949761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:24.049366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478e6b2-820b-4d46-9d98-490120ac4af1 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:24.050901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:24.082118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:24.082736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:24.083013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:24.083282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:24.091904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:24.093351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:51:24.104327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:24.105472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:24.106672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 607/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:24.111314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:24.212244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c1c-946b-4112-8259-83eb49f7c382 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:24.246012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:24.246611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:24.246884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:24.247406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:24.248126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:24.248421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:24.250028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:24.267404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 606/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Oct 10 11:51:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:24.273260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:24.371255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92b940-64b0-444f-b9bb-f9ef5f57007b None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:24.405972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:24.406581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:24.406861 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:24.407130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:24.436798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:24.474723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:24.476137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:24.576408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 608/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:51:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:24.582407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:24.600974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:24.682408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6ce23-7f26-4929-a5d2-72d9e447af72 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:24.718961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:24.719609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:24.719890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:24.720163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:24.731948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:24.733291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:24.749101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:24.754457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:24.755588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:24.755588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:24.755588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:24.755588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 607/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:24.756673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:24.817443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:24.854911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836f76e-e936-46a0-9920-c26af0e1a6de None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:24.889086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:24.889683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:24.889994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:24.890271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:24.891002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:24.891319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:24.892750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:24.903713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 609/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:51:24.909387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:24.978293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:25.009689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d025-a1b3-46f4-a7ab-b688f425a838 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:25.041682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:25.042334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:25.043135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:25.043455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:25.049881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:25.051435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:51:25.063080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:25.064191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:25.065120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 608/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:25.070141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:25.171819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6d6b1-bcd6-481c-8b9b-e8242b9dfa88 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:25.194501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:25.206113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:25.206714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:25.206993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:25.207265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:25.207952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:25.208254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:25.209788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c95f4-0c62-4dce-9eb5-ca0f6e04508f None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:25.222118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 610/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:51:25.228420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:25.337558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328a41a-4e71-4857-9e40-0c3b5ae50019 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:25.365940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:25.371551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:25.372420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:25.372693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:25.372962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:25.373678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6fa43b5c630e4d99af9a09bfad65d1cf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:25.374016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:25.375440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3c480-dc62-4ce2-b8d7-8bb2a99c103b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:25.380651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 609/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:51:25 2022] GET /identity/v3/role_assignments?user.id=6fa43b5c630e4d99af9a09bfad65d1cf&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:27.469615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d01da1-26e9-4ec7-aba4-969cc1c851a8 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:27.470363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d01da1-26e9-4ec7-aba4-969cc1c851a8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:27.470363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d01da1-26e9-4ec7-aba4-969cc1c851a8 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:27.471527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 611/1220] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:27.476759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:27.477153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:27.477307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:27.496402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:27.497940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:27.568074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 610/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:51:27.833057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d01da1-26e9-4ec7-aba4-969cc1c851a8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:27.934145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d01da1-26e9-4ec7-aba4-969cc1c851a8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:27.967939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:27.968588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:27.968870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:27.969142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:27.978927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:51:27.984212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:27.985245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:27.986267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 612/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:27.991516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:28.090145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e55e-7dbb-4dcb-9640-d72dd32e000c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:28.113079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:28.124079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:28.124676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:28.124952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:28.125221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:28.125898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:28.126199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:28.127554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:28.135243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 611/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:28.141039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:28.184670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:28.240121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef659-fbdf-4784-abbc-1684ea492e46 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:28.273160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:28.273786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:28.274273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:28.274520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:28.285348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:28.286917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:28.301213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:28.302423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:28.303607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:28.303607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:28.303607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:28.303607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 613/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:28.308210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:28.407563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d984ee-6677-42d7-9b8c-6a1e6acb49e7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:28.440792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:28.442632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:28.442632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:28.442632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:28.442632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:28.443002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:28.444217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:28.457552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 612/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:28.463306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:28.558753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:28.565328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4f8e7-b8e0-4346-987a-f3f71e94a793 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:28.598412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:28.599042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:28.599326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:28.599601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:28.607726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:28.609167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:51:28.620138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:28.621817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:28.623129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 614/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:28.628050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:28.673769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:28.726312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a9599-8f63-4f9f-8e39-2b00ecdfbb5a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:28.759802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:28.760422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:28.760690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:28.760959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:28.761672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:28.762007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:28.763424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:28.779773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 613/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Oct 10 11:51:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:28.785669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:28.885551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b50d-f0b8-4d06-8627-219214c7acdf None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:28.920123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:28.920749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:28.921034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:28.921310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:28.931754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:28.933154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:28.947246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:28.951815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:28.952932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:28.952932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:28.952932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:28.952932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 615/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:28.954202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:29.053941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9aa6-66a8-4cc9-aa16-66bac56e2bd3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:29.056223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:29.087239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:29.087835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:29.088229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:29.088537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:29.089704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:29.090062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:29.091417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:29.102140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 614/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:29.108398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:29.117626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:29.205380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c954-e1e7-4594-b939-102a36611867 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:29.237425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:29.238068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:29.238345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:29.238611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:29.244991 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:29.246475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:51:29.258242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:29.259310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:29.260460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 616/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:29.266208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:29.366787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa8663-6d5e-4310-8a89-a262b6eb75aa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:29.399711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:29.400358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:29.400634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:29.400904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:29.401583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:29.402464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:29.406094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149769f-b2aa-46b8-8703-38413a33172d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:29.415534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 615/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:29.421710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:29.488738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:29.523731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6611c-5624-4347-8225-2d68ea00397d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:29.557008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1af22-722a-453a-a15d-8cd926666668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:29.557666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1af22-722a-453a-a15d-8cd926666668 None admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:29.558483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1af22-722a-453a-a15d-8cd926666668 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:29.558763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1af22-722a-453a-a15d-8cd926666668 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6fa43b5c630e4d99af9a09bfad65d1cf/roles/a40a4f93ca55475bb2978753bcce2a59` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:29.574920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1af22-722a-453a-a15d-8cd926666668 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6fa43b5c630e4d99af9a09bfad65d1cf, role_id=a40a4f93ca55475bb2978753bcce2a59)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:29.576410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1af22-722a-453a-a15d-8cd926666668 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:29.658659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 617/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:51:29 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6fa43b5c630e4d99af9a09bfad65d1cf/roles/a40a4f93ca55475bb2978753bcce2a59 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:51:31.764225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623886b-8388-4b3c-be38-f234fb55dcb5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:31.764745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623886b-8388-4b3c-be38-f234fb55dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:31.764745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623886b-8388-4b3c-be38-f234fb55dcb5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:31.766127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 616/1233] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:31.771467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:31.771914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:31.777834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:31.790351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:31.791541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:31.856580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 618/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:51:32.126838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623886b-8388-4b3c-be38-f234fb55dcb5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:32.152849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.230843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623886b-8388-4b3c-be38-f234fb55dcb5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:32.265558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:32.266206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:32.266487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:32.266757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.276569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:51:32.281301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:32.282455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:32.283500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 617/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:32.288605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:32.334603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.385663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13865a0-d5dd-4bfd-b314-29125b9f318f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:32.417754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:32.418874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:32.419150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:32.419424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.420070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:32.420368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:32.421727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:32.429970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 619/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:32.436490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:32.522868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.538440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159944dc-1d97-4a9e-8d13-3120f72e7817 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:32.571777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:32.572390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:32.572666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:32.572936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.582579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:32.584004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:32.598487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:32.599555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:32.600818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:32.600818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:32.600818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:32.600818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 618/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:32.606157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:32.703908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdb3a5-a86f-4b75-9150-7c85f7e270e0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:32.712511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.737092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:32.737683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:32.737994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:32.738269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.738900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:32.739202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:32.740557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:32.752142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 620/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:32.763014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:32.856925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28ef8-fcf3-45a4-8f82-e08e8972cf51 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:32.889731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:32.890376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:32.890656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:32.890927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.893580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.899270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:32.900700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:51:32.911923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:32.919255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:32.920344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 619/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:32.920948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:33.017944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabb743-9bc0-4920-82fd-2e67cbe60e83 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:33.052036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:33.052626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:33.052903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:33.053172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:33.053902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:33.054206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:33.055611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:33.072512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 621/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:51:33.078545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:33.177666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5bb5a-90bb-4555-9db4-c3af6959de7b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:33.210095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:33.210683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:33.210957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:33.211221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:33.271941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:33.278684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:33.280121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:33.374214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 620/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:51:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:33.380087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:33.407274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:33.478575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8274fe-d141-4d1d-b52d-394160394b1c None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:33.512627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:33.513294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:33.513573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:33.513864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:33.523636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:33.525023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:33.540261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:33.541451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:33.542399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:33.542399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:33.542399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:33.542399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 622/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:33.547249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:33.640895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:33.646492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb454-83c4-4814-9644-7f6064575958 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:33.679785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:33.680375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:33.680652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:33.680919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:33.681552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:33.681869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:33.683219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:33.695333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 621/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:33.701033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:33.779472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:33.800286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06883c03-2acf-4cd5-8537-aff7a358c977 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:33.833228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:33.833871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:33.834158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:33.834432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:33.840990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:33.842467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:51:33.853419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:33.854494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:33.860316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 623/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:33.861334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:33.961614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c888-9958-45fc-8d64-4d589bf8eb40 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:33.995281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:33.995881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:33.996964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:33.997244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:33.997958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:33.998266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:33.999731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd70e1-d233-4dc0-8663-ff839c4b10f8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:34.011757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 622/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:34.018057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:34.118926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6e66-9698-4aeb-a659-1b9de10a2648 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:34.152178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:34.153285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:34.153569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:34.153880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:34.154596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] RBAC: Adding query filter params (role.id=a40a4f93ca55475bb2978753bcce2a59, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6fa43b5c630e4d99af9a09bfad65d1cf) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:34.154908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:34.156347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d7d49-4557-4a9e-beb3-a784d8676a42 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:34.162132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 624/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:51:34 2022] GET /identity/v3/role_assignments?user.id=6fa43b5c630e4d99af9a09bfad65d1cf&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=a40a4f93ca55475bb2978753bcce2a59 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:36.337877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65d05-4bb5-48c7-bbaa-8c1bf3dc1a40 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:36.338425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65d05-4bb5-48c7-bbaa-8c1bf3dc1a40 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:36.338425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65d05-4bb5-48c7-bbaa-8c1bf3dc1a40 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:36.339779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 623/1247] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:36.345111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:36.345491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:36.345670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:36.351982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:36.364032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:36.365214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:36.430977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 625/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:51:36.702781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65d05-4bb5-48c7-bbaa-8c1bf3dc1a40 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:36.720589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:36.802357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65d05-4bb5-48c7-bbaa-8c1bf3dc1a40 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:36.836852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:36.837555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:36.837751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:36.838056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:36.848006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:51:36.852833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:36.853921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:36.854870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 624/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:36.860601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:36.960731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99291ca3-ace7-4958-b664-69cba103b4c6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:36.990013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:36.994752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:36.995353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:36.995637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:36.996016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:36.997428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:36.997733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:36.999147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:37.007721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 626/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:51:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:37.013894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:37.090697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:37.112617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd6c1-1a14-4e1b-b47a-ff458a353171 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:37.144869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:37.145564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:37.145836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:37.148795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:37.156765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:37.158249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:37.173267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:37.178208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:37.179281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:37.179281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:37.179281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:37.179281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 625/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:37.180398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:37.279629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc488d-9b10-4ff6-bfec-919b94e1ac33 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:37.312955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:37.313559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:37.313873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:37.314145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:37.314781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:37.315125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:37.316574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:37.329280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 627/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:37.335266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:37.434025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34eeb-3725-40c7-9445-652b0ef0e48b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:37.460249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:37.470834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:37.471508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:37.471796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:37.472070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:37.480119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:37.482256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:51:37.493733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:37.494957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:37.496263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 626/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:51:37.501800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:37.557286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:37.601494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142b3c-b24a-4484-a599-2703f6d069d3 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:37.636211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:37.636870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:37.637149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:37.637421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:37.638167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:37.638479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:37.639890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:37.657505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 628/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Oct 10 11:51:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:37.662851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:37.763313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f91d6-a7ed-40b8-8a0d-d516f3839652 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:37.797765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:37.798393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:37.798673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:37.798942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:37.852849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:37.866007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:37.870017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:37.964521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 627/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:51:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:37.971010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:38.076367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe8e9-a17e-4c77-b1b1-b46884ab111e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:38.089897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.111618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:38.112179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.112458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.112781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.123099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:38.124538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:38.139618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:38.140786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:38.141899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:38.141899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:38.141899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:38.141899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 629/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:38.146710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:38.231574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.242976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8d1a-716c-4b40-888e-d84c9ffbddf9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:38.275936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:38.276529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.276802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.277069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.277702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:38.278602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:38.280009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:38.291099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 628/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:38.296800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:38.395905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49906f2-8c06-4e51-b50b-4132314b05f7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:38.428338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:38.428973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.429247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.429515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.435883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:38.437306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:51:38.448109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:38.449189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:38.450799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 630/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:38.455509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:38.558078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517f3ea-53aa-4b0e-ac4b-dcf408f6828b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:38.591341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:38.591937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.592213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.592482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.593159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:38.593462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:38.595051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabac89-8313-4517-ae1b-24cfa14272e0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:38.606675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 629/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:38.613002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:38.639722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.711571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0198-d8bb-45e6-a229-63203d9e25a0 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:38.743187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:38.743776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.744057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.744329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.745039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6fa43b5c630e4d99af9a09bfad65d1cf) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:38.745416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:38.747632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85644b3-a16b-41ce-a851-544213c1c881 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:38.752761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 631/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:51:38 2022] GET /identity/v3/role_assignments?user.id=6fa43b5c630e4d99af9a09bfad65d1cf&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:40.900065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad6fc-8f37-4fe3-9dfc-ad324f0b12cf None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:40.900578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad6fc-8f37-4fe3-9dfc-ad324f0b12cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:40.900578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad6fc-8f37-4fe3-9dfc-ad324f0b12cf None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:40.901943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 630/1261] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:40.907574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:40.908007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:40.908159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:40.927014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:40.928235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:40.994603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 632/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:51:41.264790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ad6fc-8f37-4fe3-9dfc-ad324f0b12cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:41.275705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:41.363754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ad6fc-8f37-4fe3-9dfc-ad324f0b12cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:41.396666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:41.397298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:41.397576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:41.397877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:41.408254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:51:41.412960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:41.414059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:41.419004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 631/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:41.420195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:41.437832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:41.517007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539814f-fb2d-4cf1-bbd2-3350416ee495 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:41.551080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:41.551688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:41.551969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:41.552243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:41.552925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:41.553227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:41.554601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:41.563174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 633/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:41.568584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:41.634123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:41.666456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6437-d76c-4a30-bf60-40d9d8a21239 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:41.698442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:41.699054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:41.699330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:41.700201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:41.710649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:41.712067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:41.725873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:41.727030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:41.728112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:41.728112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:41.728112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:41.728112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 632/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:41.732849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:41.813678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:41.832497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320e38a-b9be-43e7-8677-320aa6b0144e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:41.865129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:41.865736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:41.866041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:41.866312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:41.866946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:41.867246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:41.868708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:41.881439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 634/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:41.887885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:41.988548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfba222-7f95-4c94-b96d-979635cca50e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.008354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.022023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.022652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.022928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.023198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.031309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.032732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:51:42.044095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:42.045169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:42.046132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 633/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:42.051069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.149431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77a13b-47d5-4616-b6fa-95460b327ae7 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.183767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.184959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.185236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.185508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.186287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:42.186590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.188006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.196592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.204832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 635/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Oct 10 11:51:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:51:42.210664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.311110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9aca0-bc98-424d-bf0b-a18e755ce800 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.344535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.345156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.345432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.345703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.356719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.358172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:42.372246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:42.377124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:42.378320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:42.378320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:42.378320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:42.378320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 634/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:42.379207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.480434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60106bb9-3aaa-468e-a1ca-122d5577c84e None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.515394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.516002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.516307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.516583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.517270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:42.517569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.518964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.531335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 636/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:42.537067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.568812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.635474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85a346-dbec-4cf6-ab52-6183c26ace0c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.669931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.670559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.670840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.671112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.677700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.679177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:51:42.690522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:42.691573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:42.692836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 635/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:42.697577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.755764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.795692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220abc28-6839-42be-ad48-9a1aaa797510 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.828736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.829336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.829615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.829922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.830607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:42.830913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.832331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa097d-88ce-4f1a-a285-02453e60bad1 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.844803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 637/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:42.850735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.941202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.950105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf39eec-24ac-4db5-8b0a-ee8d6aaa8eca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.982818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b0fb-c414-4f23-9bef-994d3187e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.983463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b0fb-c414-4f23-9bef-994d3187e375 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.983739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b0fb-c414-4f23-9bef-994d3187e375 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.984007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b0fb-c414-4f23-9bef-994d3187e375 None admin] PATH_INFO: `/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6fa43b5c630e4d99af9a09bfad65d1cf/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.985872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b0fb-c414-4f23-9bef-994d3187e375 None admin] RBAC: Authorizing `identity:create_grant(project_id=454839cce5ad47098ca56e007a5a0baa, user_id=6fa43b5c630e4d99af9a09bfad65d1cf, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.987345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b0fb-c414-4f23-9bef-994d3187e375 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:43.065358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 636/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Oct 10 11:51:42 2022] PUT /identity/v3/projects/454839cce5ad47098ca56e007a5a0baa/users/6fa43b5c630e4d99af9a09bfad65d1cf/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:51:45.179362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a792-7613-4f86-870b-110581a2b145 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.179995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a792-7613-4f86-870b-110581a2b145 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.179995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95a792-7613-4f86-870b-110581a2b145 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:45.181253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 638/1274] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:45.187152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.187594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.187731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:45.205599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:45.215860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:45.271853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 637/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:51:45.541436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a792-7613-4f86-870b-110581a2b145 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:45.644862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95a792-7613-4f86-870b-110581a2b145 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:45.662599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:45.679001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:45.679628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.679907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.680183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:45.690543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:51:45.695246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:45.696428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:45.697552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 639/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Oct 10 11:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:45.702883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:45.784638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:45.802348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfb5a5-4a12-4db6-bf8b-58d8d3f4f5ba None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:45.836038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:45.836664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.836953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.837224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:45.837905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:45.838209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:45.839618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:45.848176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 638/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Oct 10 11:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:51:45.854215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:45.958080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2095818-ed4b-4a9e-8d5d-4e6d52fee193 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:45.991791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:45.992373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.992653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.992926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.003140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.004586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:46.019940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:46.021090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:46.022461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:46.022461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:46.022461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:46.022461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 640/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:46.026900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:46.130620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d236435-aa63-4223-8f8f-1be977591cea None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:46.163254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:46.163859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:46.164132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:46.164401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.165035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:46.165332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.166708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.178130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 639/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:46.184501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:46.216233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:46.284166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658d6c-fb9c-4860-9932-81c746ca9dec None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:46.317374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:46.318020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:46.318299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:46.318575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.326761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.328176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:51:46.339343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:46.345822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:46.346828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 641/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:46.347563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:46.350225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:46.447357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c2207-7656-4cf8-96bf-b820d0ad774e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:46.482106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:46.482635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:46.482918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:46.483197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.483929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:46.484235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.485679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.503880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 640/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:46.510071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:46.598693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:46.608568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1141f0c-b9ef-430e-b14e-3c8243b2dc48 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:46.641397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:46.642037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:46.642324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:46.642598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.707370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.708850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.798537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:46.808349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 642/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:51:46.814303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:46.875169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:46.912336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c77f2-1532-4fb7-a8b1-75d80d23b1e9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:46.946151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:46.946779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:46.947061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:46.947358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.957337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.958933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:51:46.974059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:46.975168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:51:46.976525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:51:46.976525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:51:46.976525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:46.976525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 641/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:46.981741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:47.080518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7143-1dbb-40f0-a4f1-59de13297045 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:47.114115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:47.114712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:47.114991 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:47.115261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:47.115891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:47.116193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:47.117599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:47.128825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 643/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:47.134821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:47.236289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1166d6-1519-4f39-961e-ba47cd90e961 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:47.249840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:47.270230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:47.270856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:47.271239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:47.271560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:47.278955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:47.280445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:51:47.292446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:47.293426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Oct 10 11:51:47.294409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 642/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Oct 10 11:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:47.299680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:47.349982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:47.399910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac412e-af9e-47d0-a437-2634714630f8 None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:47.433966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:47.434580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:47.434925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:47.435200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:47.435893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:47.436196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:47.437632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cc179-7b59-4d41-bcd8-a2497f86c083 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:47.450145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 644/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Oct 10 11:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:47.456043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:47.559621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed158b-5731-4452-9257-d409aceacca7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:47.593640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:47.594284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:47.594557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:47.594822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:47.595526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] RBAC: Adding query filter params (role.id=c6edd32372bf4e9a9753c56a2c760041, scope.project.id=454839cce5ad47098ca56e007a5a0baa, user.id=6fa43b5c630e4d99af9a09bfad65d1cf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:47.595827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:47.597231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807654ca-5787-40eb-887b-d2ef74bb573c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:47.603143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 643/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Oct 10 11:51:47 2022] GET /identity/v3/role_assignments?user.id=6fa43b5c630e4d99af9a09bfad65d1cf&scope.project.id=454839cce5ad47098ca56e007a5a0baa&role.id=c6edd32372bf4e9a9753c56a2c760041 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:49.763517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e334b-69d9-4731-bf32-e31b9ad29930 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:49.764023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e334b-69d9-4731-bf32-e31b9ad29930 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:49.764023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e334b-69d9-4731-bf32-e31b9ad29930 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:49.765365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 645/1288] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:49.770511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:49.770923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:49.771072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:49.789640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:49.790850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:49.819652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:49.855138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 644/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:51:50.118991 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e334b-69d9-4731-bf32-e31b9ad29930 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:50.219025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e334b-69d9-4731-bf32-e31b9ad29930 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:50.229352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:50.252619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de143322-a378-473b-87ef-409af4649d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:50.253250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143322-a378-473b-87ef-409af4649d3d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:50.253531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143322-a378-473b-87ef-409af4649d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:50.253805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de143322-a378-473b-87ef-409af4649d3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:50.254415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de143322-a378-473b-87ef-409af4649d3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:50.255771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de143322-a378-473b-87ef-409af4649d3d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-de143322-a378-473b-87ef-409af4649d3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:50.264860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:50.266106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:50.267141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 646/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:51:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:50.271939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:50.370958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29b55-f5df-49f6-8a3f-ce02d10b2a03 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:50.405659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:50.406287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:50.406568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:50.406841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:50.407465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:50.407765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:50.409121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9172-2d1d-486b-9968-6d0f8534bdcc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:50.413900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 645/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Oct 10 11:51:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:50.419684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de143322-a378-473b-87ef-409af4649d3d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:50.520430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de143322-a378-473b-87ef-409af4649d3d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:50.553579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:50.554202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:50.554485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:50.554758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] PATH_INFO: `/v3/services` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:50.555379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:50.555682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:50.557105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d1bf-5bd5-4ca9-b234-6eaa3a84e24a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:50.562002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 647/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Oct 10 11:51:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:52.716302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a9c87-edac-43bf-a1b0-037f2be6e362 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:52.716820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a9c87-edac-43bf-a1b0-037f2be6e362 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:52.716820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a9c87-edac-43bf-a1b0-037f2be6e362 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:52.718162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 646/1293] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:51:52.723337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222704-ec16-4871-9166-061440a6133a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:52.723727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222704-ec16-4871-9166-061440a6133a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:52.723889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50222704-ec16-4871-9166-061440a6133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:52.742467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-50222704-ec16-4871-9166-061440a6133a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:52.743658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50222704-ec16-4871-9166-061440a6133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:52.772669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:52.810067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 648/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:51:53.082574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a9c87-edac-43bf-a1b0-037f2be6e362 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:53.113931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:53.189753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a9c87-edac-43bf-a1b0-037f2be6e362 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:53.227143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649a2e-5e37-458f-b61c-f9a85a12de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:53.227784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649a2e-5e37-458f-b61c-f9a85a12de6e None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:53.228165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649a2e-5e37-458f-b61c-f9a85a12de6e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:53.228444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649a2e-5e37-458f-b61c-f9a85a12de6e None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:53.229133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649a2e-5e37-458f-b61c-f9a85a12de6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:53.230717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649a2e-5e37-458f-b61c-f9a85a12de6e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:53.349300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 647/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Oct 10 11:51:53 2022] POST /identity/v3/services => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:51:55.518626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45613ae-6d55-4d31-89ce-d13e6926bab5 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:55.519230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45613ae-6d55-4d31-89ce-d13e6926bab5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:55.519333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45613ae-6d55-4d31-89ce-d13e6926bab5 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:55.520683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 649/1296] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:55.525922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:55.526393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:55.526500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:55.544977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:55.546200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:55.619434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 648/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:51:55.887838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45613ae-6d55-4d31-89ce-d13e6926bab5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:55.988113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45613ae-6d55-4d31-89ce-d13e6926bab5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:56.021238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:56.021878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:56.022167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:56.022442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] PATH_INFO: `/v3/services/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:56.023026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:56.024386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:56.033701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:56.034993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:56.036068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 650/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:51:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:56.040867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:56.059618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:56.138839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fe6e-f521-42de-8e27-f93473963d7b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:56.173096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:56.173687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:56.174047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:56.174339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:56.174956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:56.175302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:56.176733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:56.181635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 649/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Oct 10 11:51:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:56.187660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:56.219660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:56.287712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75c1e-7fe4-4d5a-ac03-49578919a2ff None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:56.320299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:56.320891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:56.321168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:56.321436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:56.322158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] RBAC: Adding query filter params (interface=public, service_id=2b104a1ebd514d7a9335cbe300f96b23, region_id=RegionOne) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:56.322464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:56.323868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fef15-8557-4793-9c73-d14a6b8cf40a None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:56.329198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 651/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Oct 10 11:51:56 2022] GET /identity/v3/endpoints?service_id=2b104a1ebd514d7a9335cbe300f96b23&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:56.335008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:56.415131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:56.432880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772fb7b-c7ca-41bd-a862-01b57a823a96 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:56.468482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1ab5-9000-4f32-9c84-612e64aff891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:56.470540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1ab5-9000-4f32-9c84-612e64aff891 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:56.470540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1ab5-9000-4f32-9c84-612e64aff891 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:56.470540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1ab5-9000-4f32-9c84-612e64aff891 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:56.470540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1ab5-9000-4f32-9c84-612e64aff891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:56.471579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1ab5-9000-4f32-9c84-612e64aff891 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:56.478559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 650/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Oct 10 11:51:56 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 11:51:58.631352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910cd7-4264-4bb5-a5de-86a9d8e3108d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:58.631936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910cd7-4264-4bb5-a5de-86a9d8e3108d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:58.632036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910cd7-4264-4bb5-a5de-86a9d8e3108d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:58.633332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 652/1302] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:58.638612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:58.639013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:58.639161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:58.656879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:58.661686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:58.723216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 651/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:51:58.992697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910cd7-4264-4bb5-a5de-86a9d8e3108d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:59.089180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:59.096318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75910cd7-4264-4bb5-a5de-86a9d8e3108d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:59.129389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:59.130052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:59.130329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:59.130600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:59.131171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:59.132546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:51:59.141653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:51:59.142837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application with Lock( Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: ERROR keystone.server.flask.application Oct 10 11:51:59.143848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 653/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Oct 10 11:51:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:51:59.148952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:59.225057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:59.247295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a68a-6fcb-4fd8-858c-3717cfe15031 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:59.281004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:59.281600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:59.281901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:59.282177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:59.282805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:51:59.283101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:59.284468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513c28-53cd-4123-89e8-0953146e9224 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:59.289570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 652/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Oct 10 11:51:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:51:59.295725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:59.396050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0674-1f31-4251-8544-d46eb0eb416d None admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:59.429556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1bf10-b8af-4d74-82d6-cdb3b9d27d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:59.430187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1bf10-b8af-4d74-82d6-cdb3b9d27d67 None admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:59.430473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1bf10-b8af-4d74-82d6-cdb3b9d27d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:59.430745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1bf10-b8af-4d74-82d6-cdb3b9d27d67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:59.431490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1bf10-b8af-4d74-82d6-cdb3b9d27d67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:59.432875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1bf10-b8af-4d74-82d6-cdb3b9d27d67 None admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:59.544695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 654/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 11:51:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:52:09.286606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=30 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:09.539916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:38.483927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f459d-de08-4b8b-98d5-6c858cb5332c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.485903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f459d-de08-4b8b-98d5-6c858cb5332c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.486401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f459d-de08-4b8b-98d5-6c858cb5332c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.488702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 653/1307] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:59:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:38.497961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e7952-f79c-4724-bce5-80ded7c57d4e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.498507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e7952-f79c-4724-bce5-80ded7c57d4e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.498938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e7952-f79c-4724-bce5-80ded7c57d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.702843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b21e7952-f79c-4724-bce5-80ded7c57d4e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:38.704817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b21e7952-f79c-4724-bce5-80ded7c57d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:38.837482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 655/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:39.143430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e4e0-79c5-4d1a-931a-f7b2704ecf75 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.143874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e4e0-79c5-4d1a-931a-f7b2704ecf75 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.144190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9e4e0-79c5-4d1a-931a-f7b2704ecf75 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.145485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 654/1309] 10.222.0.47 () {54 vars in 964 bytes} [Mon Oct 10 11:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:39.152979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd9ba-2223-4a57-8cc8-57017559e805 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.153270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd9ba-2223-4a57-8cc8-57017559e805 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.153702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd9ba-2223-4a57-8cc8-57017559e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.255571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b2dbd9ba-2223-4a57-8cc8-57017559e805 None None] MFA Rules not processed for user `aa49e174aaa14829a0281441a834ef4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:39.256840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b2dbd9ba-2223-4a57-8cc8-57017559e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.285372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:39.364894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 656/1310] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Oct 10 11:59:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:39.374436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e4e0-79c5-4d1a-931a-f7b2704ecf75 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:39.376163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-56d9e4e0-79c5-4d1a-931a-f7b2704ecf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.513224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9e4e0-79c5-4d1a-931a-f7b2704ecf75 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:39.612002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:39.612796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.612796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.614225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.615438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.688242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:39.765809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:39.767590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a29f2-fe5e-4e6c-8d0f-16a8fb78c379 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:39.788937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 655/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:42.286596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3e339-8d90-4e87-8d45-74b2be1c7f01 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.287235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3e339-8d90-4e87-8d45-74b2be1c7f01 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.287235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3e339-8d90-4e87-8d45-74b2be1c7f01 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:42.288690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 657/1312] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:42.294056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c9e6-3026-4cd2-8d99-5853c3ab95e3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.294617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c9e6-3026-4cd2-8d99-5853c3ab95e3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.294617 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c9e6-3026-4cd2-8d99-5853c3ab95e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:42.390595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-00d4c9e6-3026-4cd2-8d99-5853c3ab95e3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:42.391699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-00d4c9e6-3026-4cd2-8d99-5853c3ab95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:42.549436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 656/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:42.834350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3e339-8d90-4e87-8d45-74b2be1c7f01 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:42.835898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d9f3e339-8d90-4e87-8d45-74b2be1c7f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:42.950317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3e339-8d90-4e87-8d45-74b2be1c7f01 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.024823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:43.027819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.028425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.028708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.028976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.030645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:43.145401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.146793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb913a6-5c33-414c-bbfe-ecb0a5c55e4d service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.166497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 658/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:45.851270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174f02-b983-4d44-a3e9-210f6c8ec33c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.851803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174f02-b983-4d44-a3e9-210f6c8ec33c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.851898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174f02-b983-4d44-a3e9-210f6c8ec33c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.853226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 657/1315] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:45.859529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4624ca-faf2-41d1-877c-da75cd42fa8e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.860022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4624ca-faf2-41d1-877c-da75cd42fa8e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.860176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4624ca-faf2-41d1-877c-da75cd42fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.933663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ad4624ca-faf2-41d1-877c-da75cd42fa8e None None] MFA Rules not processed for user `f10b830c5b1b4b53ac81d5dad7ab55a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:45.934966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ad4624ca-faf2-41d1-877c-da75cd42fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:45.992168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:46.036951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 659/1316] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:46.338391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb56a5f-6e69-47ee-9c04-a2eff9c67af0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.338675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb56a5f-6e69-47ee-9c04-a2eff9c67af0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.339033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb56a5f-6e69-47ee-9c04-a2eff9c67af0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.340896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 658/1317] 10.222.0.47 () {54 vars in 964 bytes} [Mon Oct 10 11:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:46.346954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772dcb-506f-4925-8796-ab7da287da2e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.347241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772dcb-506f-4925-8796-ab7da287da2e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.347515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772dcb-506f-4925-8796-ab7da287da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.430734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a1772dcb-506f-4925-8796-ab7da287da2e None None] MFA Rules not processed for user `aa49e174aaa14829a0281441a834ef4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:46.431949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a1772dcb-506f-4925-8796-ab7da287da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.514706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 660/1318] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Oct 10 11:59:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:46.523958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb56a5f-6e69-47ee-9c04-a2eff9c67af0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:46.525494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dbb56a5f-6e69-47ee-9c04-a2eff9c67af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.535983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:46.642501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb56a5f-6e69-47ee-9c04-a2eff9c67af0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:46.720882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:46.721491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.721806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.722112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.723742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.790655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:46.841398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:46.842887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f69c0f-dd8a-4921-8083-a85073c1f934 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:46.862086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 659/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:50.261651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728db6-9829-4706-9a71-79b379f9f1e0 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.262223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728db6-9829-4706-9a71-79b379f9f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.262223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728db6-9829-4706-9a71-79b379f9f1e0 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.263646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 661/1320] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:50.269153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856307e-b02c-4d55-b8cb-1357a5e7ce11 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.269602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856307e-b02c-4d55-b8cb-1357a5e7ce11 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.269694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856307e-b02c-4d55-b8cb-1357a5e7ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.339438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0856307e-b02c-4d55-b8cb-1357a5e7ce11 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:50.340675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0856307e-b02c-4d55-b8cb-1357a5e7ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:50.439485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 660/1321] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:59:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:50.726924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19728db6-9829-4706-9a71-79b379f9f1e0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.728454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-19728db6-9829-4706-9a71-79b379f9f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:50.780973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:50.835097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19728db6-9829-4706-9a71-79b379f9f1e0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.915885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.916509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.916791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.917602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.919361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:51.030164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:51.044690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:51.046306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32baf1-a838-408f-8fe5-20998297c735 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:51.065328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 662/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:54.357004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deca19-770e-43cd-bef4-2b02e2142fee None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:54.357547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deca19-770e-43cd-bef4-2b02e2142fee None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:54.357547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0deca19-770e-43cd-bef4-2b02e2142fee None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:54.358925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 661/1323] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:54.365105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da85aa-7063-4441-8a2c-444a6ffcb8f6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:54.365557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da85aa-7063-4441-8a2c-444a6ffcb8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:54.365652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da85aa-7063-4441-8a2c-444a6ffcb8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:54.435324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-76da85aa-7063-4441-8a2c-444a6ffcb8f6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:54.436577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-76da85aa-7063-4441-8a2c-444a6ffcb8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:54.557451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 663/1324] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:54.844601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0deca19-770e-43cd-bef4-2b02e2142fee None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:54.847510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b0deca19-770e-43cd-bef4-2b02e2142fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:54.884075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:54.998504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0deca19-770e-43cd-bef4-2b02e2142fee None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:55.086974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:55.087580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:55.087856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:55.088123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:55.089895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:55.187331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:55.236219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:55.237664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e894cd-6199-4531-ad2f-dd79103df0a8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:55.259945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 662/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:57.929103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5b94-2304-4771-87e3-7d8ee4625ec3 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.929923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5b94-2304-4771-87e3-7d8ee4625ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.929923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5b94-2304-4771-87e3-7d8ee4625ec3 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.931166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 664/1326] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 11:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:57.937322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a83e-f69b-40f4-b478-b075c9f832c8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.938170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a83e-f69b-40f4-b478-b075c9f832c8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.938170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a83e-f69b-40f4-b478-b075c9f832c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:58.036215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dcd8a83e-f69b-40f4-b478-b075c9f832c8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:58.038718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dcd8a83e-f69b-40f4-b478-b075c9f832c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.166765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 663/1327] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:58.462688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5b94-2304-4771-87e3-7d8ee4625ec3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:58.466484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-113a5b94-2304-4771-87e3-7d8ee4625ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.576198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:58.655565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5b94-2304-4771-87e3-7d8ee4625ec3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:58.762067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:58.762720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:58.763098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:58.763496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:58.765310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.897298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:58.900277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:58.901962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371a009-afd5-4dd7-9b81-4e1b144d06da service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:58.928350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 665/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:01.524677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd08a-e1fe-46be-80a5-5202e0279b20 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.525257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd08a-e1fe-46be-80a5-5202e0279b20 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.525257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd08a-e1fe-46be-80a5-5202e0279b20 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.526653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 664/1329] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:01.532931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88265d8-8b75-48e6-9072-91b3ee70c21a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.533428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88265d8-8b75-48e6-9072-91b3ee70c21a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.533693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88265d8-8b75-48e6-9072-91b3ee70c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.628668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c88265d8-8b75-48e6-9072-91b3ee70c21a None None] MFA Rules not processed for user `f10b830c5b1b4b53ac81d5dad7ab55a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:01.630805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c88265d8-8b75-48e6-9072-91b3ee70c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:01.762428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 666/1330] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:02.055780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd08a-e1fe-46be-80a5-5202e0279b20 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:02.058491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8f9dd08a-e1fe-46be-80a5-5202e0279b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:02.103211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:02.186082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd08a-e1fe-46be-80a5-5202e0279b20 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:02.272561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:02.273316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:02.273597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:02.273891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:02.275564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:02.362432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:02.395489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:02.397079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231428ee-ed5f-42ce-973f-2ce62b4211f9 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:02.419387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 665/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:05.075416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cd959-9c77-441c-ae5d-fc944e8cd46b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.076057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cd959-9c77-441c-ae5d-fc944e8cd46b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.076057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cd959-9c77-441c-ae5d-fc944e8cd46b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.077222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 667/1332] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:05.082746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b6e6-9b95-4e1c-a9ec-d89d35cc8ba1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.083223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b6e6-9b95-4e1c-a9ec-d89d35cc8ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.083412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b6e6-9b95-4e1c-a9ec-d89d35cc8ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.154364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-49f5b6e6-9b95-4e1c-a9ec-d89d35cc8ba1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:05.155605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-49f5b6e6-9b95-4e1c-a9ec-d89d35cc8ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.257838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 666/1333] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:05.539809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cd959-9c77-441c-ae5d-fc944e8cd46b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.542047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-695cd959-9c77-441c-ae5d-fc944e8cd46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.614965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:05.654973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cd959-9c77-441c-ae5d-fc944e8cd46b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.736991 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.737524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.738078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.738362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.740013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.866614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.868067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fa18d-e0ef-4565-a675-518dd0ae30f1 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.879922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:05.889107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 668/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:08.150272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d4ea-9b09-4c55-858a-cdcc54e55230 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.150840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d4ea-9b09-4c55-858a-cdcc54e55230 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.150840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d4ea-9b09-4c55-858a-cdcc54e55230 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.152173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 667/1335] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:08.158006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd931f5-c064-4a3e-bdf3-2c102376ebbb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.158519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd931f5-c064-4a3e-bdf3-2c102376ebbb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.158665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd931f5-c064-4a3e-bdf3-2c102376ebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.240628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cbd931f5-c064-4a3e-bdf3-2c102376ebbb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:08.241909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cbd931f5-c064-4a3e-bdf3-2c102376ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.349890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 669/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:08.635904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d4ea-9b09-4c55-858a-cdcc54e55230 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.637619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0cf3d4ea-9b09-4c55-858a-cdcc54e55230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.681486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.755394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d4ea-9b09-4c55-858a-cdcc54e55230 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.834798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.835558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.835931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.836329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.838111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.941270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.969542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.971042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1660-53e7-4f38-b623-568113a62eaf service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.991533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 668/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:11.974896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330005-af0d-45d8-8fa6-d01c6630043b None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.975456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330005-af0d-45d8-8fa6-d01c6630043b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.975456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330005-af0d-45d8-8fa6-d01c6630043b None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.976897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 670/1338] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:11.983347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6bce-6a55-4c67-ad68-c7b32e08d837 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.983900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6bce-6a55-4c67-ad68-c7b32e08d837 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.983900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a6bce-6a55-4c67-ad68-c7b32e08d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:12.053001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f78a6bce-6a55-4c67-ad68-c7b32e08d837 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:12.054174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f78a6bce-6a55-4c67-ad68-c7b32e08d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:12.152952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 669/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:12.439760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330005-af0d-45d8-8fa6-d01c6630043b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:12.441408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-82330005-af0d-45d8-8fa6-d01c6630043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:12.532468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:12.562690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330005-af0d-45d8-8fa6-d01c6630043b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:12.642758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:12.643370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:12.643651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:12.643923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:12.645542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:12.758312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:12.759868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4467b6-6852-414a-9a83-6cb019a0003a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:12.779246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 671/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:17.335401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041e7c8-eeae-441a-a446-ae11d1c41795 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.335972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041e7c8-eeae-441a-a446-ae11d1c41795 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.335972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041e7c8-eeae-441a-a446-ae11d1c41795 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.337287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 670/1341] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:17.343073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0707f2-3e9e-4349-a5b1-ff6251654fef None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.343569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0707f2-3e9e-4349-a5b1-ff6251654fef None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.343665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0707f2-3e9e-4349-a5b1-ff6251654fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.349288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.419646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-af0707f2-3e9e-4349-a5b1-ff6251654fef None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:17.420867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-af0707f2-3e9e-4349-a5b1-ff6251654fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.538473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 672/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:17.829251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041e7c8-eeae-441a-a446-ae11d1c41795 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.831260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3041e7c8-eeae-441a-a446-ae11d1c41795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.889779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.952825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041e7c8-eeae-441a-a446-ae11d1c41795 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.044116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.044746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.045025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.045302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.047028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.157994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:18.178723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.180185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c550e-fc29-4224-8536-2e8c8a4ffd24 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.201096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 671/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:21.470911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5ccf-bb84-4fa8-9120-61a47984cbbd None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.471517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5ccf-bb84-4fa8-9120-61a47984cbbd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.471517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5ccf-bb84-4fa8-9120-61a47984cbbd None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.472873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 673/1344] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:21.482823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a39d1-6cd9-4fea-965a-70f246982f6b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.483424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a39d1-6cd9-4fea-965a-70f246982f6b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.483765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a39d1-6cd9-4fea-965a-70f246982f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.598562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-171a39d1-6cd9-4fea-965a-70f246982f6b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:21.600173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-171a39d1-6cd9-4fea-965a-70f246982f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.733475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 672/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:22.026702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a5ccf-bb84-4fa8-9120-61a47984cbbd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.028273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c41a5ccf-bb84-4fa8-9120-61a47984cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.157576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:22.177129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a5ccf-bb84-4fa8-9120-61a47984cbbd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.302990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.303617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.303894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.304169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.305877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.457154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.459517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463360da-ad40-413c-bcb3-8d66ce8942ea service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.490475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 674/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:27.579680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f57e-d542-4b7e-ab14-dd17205f8f10 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.580275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f57e-d542-4b7e-ab14-dd17205f8f10 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.580275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f57e-d542-4b7e-ab14-dd17205f8f10 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.581629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 673/1347] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:27.587511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf113-acef-4ab4-b7b1-79820b13c622 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.588209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf113-acef-4ab4-b7b1-79820b13c622 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.588209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf113-acef-4ab4-b7b1-79820b13c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.605415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:27.684978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d7baf113-acef-4ab4-b7b1-79820b13c622 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:27.687154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d7baf113-acef-4ab4-b7b1-79820b13c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:27.808903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 675/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:28.127493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1f57e-d542-4b7e-ab14-dd17205f8f10 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:28.129017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-93b1f57e-d542-4b7e-ab14-dd17205f8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:28.191826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:28.249822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1f57e-d542-4b7e-ab14-dd17205f8f10 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:28.326032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:28.326636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:28.326910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:28.327180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:28.328782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:28.441136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:28.444451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:28.445921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab57f2e-93a8-43b1-b78f-7515dd2373f1 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:28.465895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 674/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:33.574751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df30b8-9421-4219-b622-fa802ac32cc2 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.575221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df30b8-9421-4219-b622-fa802ac32cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.575309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df30b8-9421-4219-b622-fa802ac32cc2 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.576801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 676/1350] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:33.583149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c04b-d673-4781-b700-e682eb9dbef1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.584084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c04b-d673-4781-b700-e682eb9dbef1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.584578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c04b-d673-4781-b700-e682eb9dbef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.708682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0610c04b-d673-4781-b700-e682eb9dbef1 None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:33.710409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0610c04b-d673-4781-b700-e682eb9dbef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.859392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 675/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:37.807341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=59 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:38.847711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf619e-e933-4223-8e62-209f44c9b33e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:38.848823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf619e-e933-4223-8e62-209f44c9b33e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:38.848823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf619e-e933-4223-8e62-209f44c9b33e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:38.852168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 677/1352] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:00:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:38.860752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283558-a87c-427b-a407-b94bc1c42dae None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:38.861551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283558-a87c-427b-a407-b94bc1c42dae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:38.862367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283558-a87c-427b-a407-b94bc1c42dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:38.968675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:39.007663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2a283558-a87c-427b-a407-b94bc1c42dae None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:39.009190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a283558-a87c-427b-a407-b94bc1c42dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.231262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 676/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:40.465326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b34cf-d537-4b81-82a3-d25e59698136 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.466154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b34cf-d537-4b81-82a3-d25e59698136 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.466313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b34cf-d537-4b81-82a3-d25e59698136 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.468429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 678/1354] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:40.474185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f528a-67ae-4350-a7dd-bb8496f55869 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.474942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f528a-67ae-4350-a7dd-bb8496f55869 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.474942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f528a-67ae-4350-a7dd-bb8496f55869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.591240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-112f528a-67ae-4350-a7dd-bb8496f55869 None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:40.593285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-112f528a-67ae-4350-a7dd-bb8496f55869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.647711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:40.737833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 677/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:44.274995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca24575-73ef-4e5a-a81d-8be98322179a None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.275573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca24575-73ef-4e5a-a81d-8be98322179a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.275573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca24575-73ef-4e5a-a81d-8be98322179a None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.277222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 679/1356] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:44.283093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324517-7c5d-4f68-8090-52fbcaaddd7f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.283839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324517-7c5d-4f68-8090-52fbcaaddd7f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.283839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a324517-7c5d-4f68-8090-52fbcaaddd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.384762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5a324517-7c5d-4f68-8090-52fbcaaddd7f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:44.388489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5a324517-7c5d-4f68-8090-52fbcaaddd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:44.615694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 678/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:44.985013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21674529-acbf-4850-b958-26f419fdd694 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.985345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21674529-acbf-4850-b958-26f419fdd694 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.985586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21674529-acbf-4850-b958-26f419fdd694 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.987351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 680/1358] 10.222.0.47 () {54 vars in 961 bytes} [Mon Oct 10 12:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:45.003032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487589-59a5-486c-bdb6-e4dbab00e38c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:45.003596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487589-59a5-486c-bdb6-e4dbab00e38c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:45.004032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487589-59a5-486c-bdb6-e4dbab00e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:45.028258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:45.103915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b4487589-59a5-486c-bdb6-e4dbab00e38c None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:45.105418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b4487589-59a5-486c-bdb6-e4dbab00e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:45.237252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 679/1359] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Oct 10 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:45.245521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21674529-acbf-4850-b958-26f419fdd694 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:45.247015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-21674529-acbf-4850-b958-26f419fdd694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:45.411211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21674529-acbf-4850-b958-26f419fdd694 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:45.503606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:45.547116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:45.548361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:45.549000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:45.549760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:45.551519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:45.650164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:45.651794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c782a-1704-4982-8784-9252ce39bbf4 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:45.671035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 681/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:48.391132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270693-68ee-48f1-a800-091b51be8ec8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.391698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270693-68ee-48f1-a800-091b51be8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.391698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270693-68ee-48f1-a800-091b51be8ec8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.393330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 680/1361] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:00:48.399780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f12e-6b34-4e39-a87e-0f998f4abc8e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.400620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f12e-6b34-4e39-a87e-0f998f4abc8e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.400620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f12e-6b34-4e39-a87e-0f998f4abc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.490899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1463f12e-6b34-4e39-a87e-0f998f4abc8e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:48.492206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1463f12e-6b34-4e39-a87e-0f998f4abc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:48.544342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:48.641877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 682/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:48.932937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270693-68ee-48f1-a800-091b51be8ec8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.935055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae270693-68ee-48f1-a800-091b51be8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.017996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:49.153572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270693-68ee-48f1-a800-091b51be8ec8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:49.405538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:49.406929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.407745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.408515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.412173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.465810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:49.611029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:49.621413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be2ea9-de19-4032-bf0a-79df47687f91 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:49.639577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 681/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:52.418937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d013a-b330-446e-89da-38ad03bd88f2 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.419510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d013a-b330-446e-89da-38ad03bd88f2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.419510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d013a-b330-446e-89da-38ad03bd88f2 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.421012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 683/1364] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:52.426213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536734-3b05-442c-98a4-8fb0617efe4a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.426634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536734-3b05-442c-98a4-8fb0617efe4a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.426828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536734-3b05-442c-98a4-8fb0617efe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.507632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b8536734-3b05-442c-98a4-8fb0617efe4a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:52.508905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b8536734-3b05-442c-98a4-8fb0617efe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:52.613554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:52.622177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 682/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:52.908528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa44d9c-8560-4425-ae9a-4278d106df53 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.909086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa44d9c-8560-4425-ae9a-4278d106df53 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.909432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa44d9c-8560-4425-ae9a-4278d106df53 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.911404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 684/1366] 10.222.0.47 () {54 vars in 961 bytes} [Mon Oct 10 12:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:52.918449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527380f-d901-4c8a-a677-c15f92ed0461 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.918961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527380f-d901-4c8a-a677-c15f92ed0461 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.919251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527380f-d901-4c8a-a677-c15f92ed0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.017299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2527380f-d901-4c8a-a677-c15f92ed0461 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:53.018564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2527380f-d901-4c8a-a677-c15f92ed0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:53.161657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 683/1367] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Oct 10 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:53.169815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa44d9c-8560-4425-ae9a-4278d106df53 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.171420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ffa44d9c-8560-4425-ae9a-4278d106df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:53.369540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa44d9c-8560-4425-ae9a-4278d106df53 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.395041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:53.520565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.521237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.521506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.521774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.523423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:53.632482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.634720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bb120-9a44-41d2-9f5a-10409bc9ab75 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.655111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 685/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:53.683626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076363-ddf8-4b10-8caa-6b553ac207c6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.684679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076363-ddf8-4b10-8caa-6b553ac207c6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.685019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076363-ddf8-4b10-8caa-6b553ac207c6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.686852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 684/1369] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:53.693050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba24b-849a-4e33-a2a0-d51850256297 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.693439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba24b-849a-4e33-a2a0-d51850256297 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.693786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ba24b-849a-4e33-a2a0-d51850256297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.731715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:53.768549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2a7ba24b-849a-4e33-a2a0-d51850256297 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:53.769910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a7ba24b-849a-4e33-a2a0-d51850256297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:53.887501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 686/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:54.192704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589c5c-57b4-4b44-8f11-859e617e9dae None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.193213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589c5c-57b4-4b44-8f11-859e617e9dae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.193644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589c5c-57b4-4b44-8f11-859e617e9dae None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.195451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 685/1371] 10.222.0.47 () {54 vars in 963 bytes} [Mon Oct 10 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:54.200785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499943c-5ab9-4a33-897e-25ea75dadb83 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.201277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499943c-5ab9-4a33-897e-25ea75dadb83 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.201706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499943c-5ab9-4a33-897e-25ea75dadb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.292103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9499943c-5ab9-4a33-897e-25ea75dadb83 None None] MFA Rules not processed for user `b3e8ae06eace4634ac1a52ddab162d91`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:54.293320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9499943c-5ab9-4a33-897e-25ea75dadb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:54.343484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:54.375504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 687/1372] 10.222.0.47 () {58 vars in 1060 bytes} [Mon Oct 10 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:54.382897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589c5c-57b4-4b44-8f11-859e617e9dae None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.384917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fa589c5c-57b4-4b44-8f11-859e617e9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:54.441330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:54.515395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589c5c-57b4-4b44-8f11-859e617e9dae None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.602197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.602816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.603095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.603404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.605229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:54.718657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:54.735010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.735010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a14169-2f3d-4bb6-910c-36788bcc81f4 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.754152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 686/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:56.108112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae108d-e1ec-41c4-b71d-f87daa18988d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:56.108637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae108d-e1ec-41c4-b71d-f87daa18988d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:56.108637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae108d-e1ec-41c4-b71d-f87daa18988d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:56.110009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 688/1374] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:56.115573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd725-ecc6-4ac7-aaa7-aa12002907de None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:56.116024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd725-ecc6-4ac7-aaa7-aa12002907de None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:56.116121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd725-ecc6-4ac7-aaa7-aa12002907de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:56.192498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5e0cd725-ecc6-4ac7-aaa7-aa12002907de None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:56.194042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e0cd725-ecc6-4ac7-aaa7-aa12002907de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:56.304724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 687/1375] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:56.605285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae108d-e1ec-41c4-b71d-f87daa18988d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:56.606899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-faae108d-e1ec-41c4-b71d-f87daa18988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:56.782954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae108d-e1ec-41c4-b71d-f87daa18988d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:56.848801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:56.920689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:56.921305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:56.921590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:56.921926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:56.923561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:57.029247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:57.030941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc66c8a-db48-4363-82db-941d278eca2b service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:57.058542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 689/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:59.476410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2fec-dfb7-4849-a6d0-6700639c9d38 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.477637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2fec-dfb7-4849-a6d0-6700639c9d38 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.477637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2fec-dfb7-4849-a6d0-6700639c9d38 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.478534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 688/1377] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:59.484211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172050ae-9a7d-431f-9708-9cfae6e75a34 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.484701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172050ae-9a7d-431f-9708-9cfae6e75a34 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.484827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172050ae-9a7d-431f-9708-9cfae6e75a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.560056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-172050ae-9a7d-431f-9708-9cfae6e75a34 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:59.561325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-172050ae-9a7d-431f-9708-9cfae6e75a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:59.569470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:59.670169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 690/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:59.965150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e2fec-dfb7-4849-a6d0-6700639c9d38 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.966906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-769e2fec-dfb7-4849-a6d0-6700639c9d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:00.056310 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:00.177347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e2fec-dfb7-4849-a6d0-6700639c9d38 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:00.345618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:00.346277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:00.346557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:00.346844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:00.348477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:00.370978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:00.455542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:00.459541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ab3c6-8b94-496a-a3ab-b5d11f72c05c service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:00.481020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 689/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:03.072583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19bc07-9cd6-44a2-ba94-6ba56341ea8d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.073121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19bc07-9cd6-44a2-ba94-6ba56341ea8d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.073121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19bc07-9cd6-44a2-ba94-6ba56341ea8d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.074534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 691/1380] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:03.080048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b97eec-e7b2-4f26-bf2f-8c21f576c841 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.080465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b97eec-e7b2-4f26-bf2f-8c21f576c841 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.080616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b97eec-e7b2-4f26-bf2f-8c21f576c841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.155140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-28b97eec-e7b2-4f26-bf2f-8c21f576c841 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:03.156410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-28b97eec-e7b2-4f26-bf2f-8c21f576c841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:03.256091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:03.262942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 690/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:03.560448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19bc07-9cd6-44a2-ba94-6ba56341ea8d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.562080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fc19bc07-9cd6-44a2-ba94-6ba56341ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:03.707960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:03.718556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19bc07-9cd6-44a2-ba94-6ba56341ea8d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.848688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:03.849190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.849467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.849736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.851390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:03.943819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:03.946269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92728b-95a1-4ebd-b89a-8926983f2fcd service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:03.956620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:03.969331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 692/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:06.670329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726a8e7-7f2a-4456-8e06-9fa897150e71 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:06.671501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726a8e7-7f2a-4456-8e06-9fa897150e71 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:06.671501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726a8e7-7f2a-4456-8e06-9fa897150e71 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:06.672208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 691/1383] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:06.678058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f1d8d-cae8-4af2-b0ea-876ae44dbe8a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:06.678530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f1d8d-cae8-4af2-b0ea-876ae44dbe8a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:06.678611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f1d8d-cae8-4af2-b0ea-876ae44dbe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:06.749737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a20f1d8d-cae8-4af2-b0ea-876ae44dbe8a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:06.750934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a20f1d8d-cae8-4af2-b0ea-876ae44dbe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:06.853613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 693/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:07.140808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726a8e7-7f2a-4456-8e06-9fa897150e71 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:07.142456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3726a8e7-7f2a-4456-8e06-9fa897150e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:07.334571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726a8e7-7f2a-4456-8e06-9fa897150e71 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:07.415919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:07.467462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:07.468058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:07.468335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:07.468607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:07.470230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:07.579120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:07.581338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340eef3-43b5-48d0-a6fb-0c6c23f04940 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:07.608121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 692/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:01:09.783412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0462-4f62-4fcb-a2e2-7588fae85640 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.784023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0462-4f62-4fcb-a2e2-7588fae85640 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.784023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0462-4f62-4fcb-a2e2-7588fae85640 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.785313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 694/1386] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:09.791605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ea9d-5881-451e-b3e9-dba31c391cf8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.792087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ea9d-5881-451e-b3e9-dba31c391cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.792087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ea9d-5881-451e-b3e9-dba31c391cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.863480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f7a0ea9d-5881-451e-b3e9-dba31c391cf8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:09.864705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f7a0ea9d-5881-451e-b3e9-dba31c391cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:09.900179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:09.966906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 693/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:10.266697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b0462-4f62-4fcb-a2e2-7588fae85640 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:10.268523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cc2b0462-4f62-4fcb-a2e2-7588fae85640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:10.349997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:10.423749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b0462-4f62-4fcb-a2e2-7588fae85640 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:10.555164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:10.555780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:10.556063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:10.556353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:10.558005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:10.561326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5040-dc50-4bc7-bf36-ebd15cecae69 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:10.561691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5040-dc50-4bc7-bf36-ebd15cecae69 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:10.562057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5040-dc50-4bc7-bf36-ebd15cecae69 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:10.563644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 694/1388] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:01:10.568867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488962-d39c-45df-a72a-d5df0ef089aa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:10.569228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488962-d39c-45df-a72a-d5df0ef089aa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:10.569573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488962-d39c-45df-a72a-d5df0ef089aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:10.602438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:10.647885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-40488962-d39c-45df-a72a-d5df0ef089aa None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:10.647885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-40488962-d39c-45df-a72a-d5df0ef089aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:10.658513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:10.660155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e2b2a-e57e-49e1-972a-42288fbbdc28 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:10.678512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 695/1389] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:10.743691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 695/1390] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:11.046181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f7ad-0ccb-4323-9de9-fcc49b16c885 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:11.046745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f7ad-0ccb-4323-9de9-fcc49b16c885 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:11.046745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4f7ad-0ccb-4323-9de9-fcc49b16c885 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:11.048122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 696/1391] 10.222.0.47 () {54 vars in 962 bytes} [Mon Oct 10 12:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:11.055919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ff2d-9fae-4f80-99e9-2b33b8151202 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:11.056471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ff2d-9fae-4f80-99e9-2b33b8151202 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:11.056471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ff2d-9fae-4f80-99e9-2b33b8151202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:11.073149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:11.143017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2737ff2d-9fae-4f80-99e9-2b33b8151202 None None] MFA Rules not processed for user `0a1bda85ce4a41ed8ec354d40ecbb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:11.144246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2737ff2d-9fae-4f80-99e9-2b33b8151202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:11.231637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 696/1392] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Oct 10 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:11.242651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f7ad-0ccb-4323-9de9-fcc49b16c885 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:11.244257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c2a4f7ad-0ccb-4323-9de9-fcc49b16c885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:11.358490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4f7ad-0ccb-4323-9de9-fcc49b16c885 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:11.423035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:11.438639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:11.439258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:11.439543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:11.439816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:11.441423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:11.561241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:11.562744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a32cd-5d0f-45c5-9279-d9f31ce3aabc service glance] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:11.581420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 697/1393] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:12.504703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164d0df-2df6-4a41-b5e6-3685b259f4d3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:12.505247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164d0df-2df6-4a41-b5e6-3685b259f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:12.505413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164d0df-2df6-4a41-b5e6-3685b259f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:12.579942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4164d0df-2df6-4a41-b5e6-3685b259f4d3 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:12.581261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4164d0df-2df6-4a41-b5e6-3685b259f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:12.638920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:12.674007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 697/1394] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:12.713884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344deaff-4095-4908-871d-dec348ebd889 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:12.714421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344deaff-4095-4908-871d-dec348ebd889 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:12.714421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344deaff-4095-4908-871d-dec348ebd889 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:12.715790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 698/1395] 10.222.0.47 () {54 vars in 943 bytes} [Mon Oct 10 12:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:12.723666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3240a86-7f10-43cd-941b-fce5ea4a7540 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:12.723961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3240a86-7f10-43cd-941b-fce5ea4a7540 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:12.724242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3240a86-7f10-43cd-941b-fce5ea4a7540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:12.807527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b3240a86-7f10-43cd-941b-fce5ea4a7540 None None] MFA Rules not processed for user `6738164d722a43c7b32706caef761fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:12.808760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b3240a86-7f10-43cd-941b-fce5ea4a7540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:12.926549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 698/1396] 10.222.0.47 () {58 vars in 1040 bytes} [Mon Oct 10 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:12.936259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344deaff-4095-4908-871d-dec348ebd889 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:12.937803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-344deaff-4095-4908-871d-dec348ebd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:13.022896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb9ca-25f6-454e-b038-bc12ec29f0a2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:13.023714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb9ca-25f6-454e-b038-bc12ec29f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:13.024000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafb9ca-25f6-454e-b038-bc12ec29f0a2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:13.025404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 699/1397] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:01:13.031091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:13.031368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:13.031642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:13.035564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:13.072185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:13.088609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344deaff-4095-4908-871d-dec348ebd889 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:13.107476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:13.108927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:13.207513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:13.207844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:13.208168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:13.208602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:13.210134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:13.212472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 700/1398] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:13.293339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:13.305815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:13.307409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be395532-0da1-416a-b232-d4838e3c854c service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:13.315583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 699/1399] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:01:13.506310 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:13.508110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:13.620438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:13.624797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44652850-db21-4004-89bd-16c77f2aeaf5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:13.761232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:13.761784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:13.762102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:13.762368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:13.764018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:13.867214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:13.868834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a4647-85cb-4a1b-a76a-bf25b450a5cd service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:13.889096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 701/1400] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:17.273566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b5493-e151-4a28-903a-3acbb9fde489 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:17.274190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b5493-e151-4a28-903a-3acbb9fde489 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:17.274190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b5493-e151-4a28-903a-3acbb9fde489 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:17.275596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 700/1401] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:17.281485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472a649-6a77-4e82-8a8b-85a077e3f78b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:17.282068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472a649-6a77-4e82-8a8b-85a077e3f78b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:17.282068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472a649-6a77-4e82-8a8b-85a077e3f78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:17.286666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:17.360563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d472a649-6a77-4e82-8a8b-85a077e3f78b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:17.362329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d472a649-6a77-4e82-8a8b-85a077e3f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:17.480888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 702/1402] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:17.812715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b5493-e151-4a28-903a-3acbb9fde489 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:17.814327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f67b5493-e151-4a28-903a-3acbb9fde489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:17.993591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b5493-e151-4a28-903a-3acbb9fde489 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:18.067895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:18.127348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:18.127961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:18.128241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:18.128516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:18.130161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:18.251016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:18.252645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124386d-a55b-4522-b8e4-822b2c61a5d5 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:18.274723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 701/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:20.604344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac796b-6ab6-4008-ab9d-0c1bbd7eaa7c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.605039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac796b-6ab6-4008-ab9d-0c1bbd7eaa7c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.605039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac796b-6ab6-4008-ab9d-0c1bbd7eaa7c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.610316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 703/1404] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:20.611955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78051-0cc7-4086-8565-58f88b664cf9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.612415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78051-0cc7-4086-8565-58f88b664cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.612533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78051-0cc7-4086-8565-58f88b664cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.686374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-92b78051-0cc7-4086-8565-58f88b664cf9 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:20.687624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-92b78051-0cc7-4086-8565-58f88b664cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:20.716107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:20.806042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 702/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:21.099020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac796b-6ab6-4008-ab9d-0c1bbd7eaa7c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:21.100535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6aac796b-6ab6-4008-ab9d-0c1bbd7eaa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:21.192569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:21.270236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac796b-6ab6-4008-ab9d-0c1bbd7eaa7c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:21.407100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:21.407705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:21.408253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:21.408537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:21.410336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:21.466827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:21.520631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:21.522308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734a637-6a72-4506-97aa-3e04e9a5548d service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:21.543011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 704/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:23.917269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45909b16-aaa1-4cd7-9260-c0e33e17dec4 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:23.917799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45909b16-aaa1-4cd7-9260-c0e33e17dec4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:23.917799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45909b16-aaa1-4cd7-9260-c0e33e17dec4 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:23.919392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 703/1407] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:23.929898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8af36-c5e4-4d76-8f28-ee61ea00c14e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:23.929898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8af36-c5e4-4d76-8f28-ee61ea00c14e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:23.929898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8af36-c5e4-4d76-8f28-ee61ea00c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.033892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-efe8af36-c5e4-4d76-8f28-ee61ea00c14e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:24.035309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-efe8af36-c5e4-4d76-8f28-ee61ea00c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.230521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 705/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:24.524056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45909b16-aaa1-4cd7-9260-c0e33e17dec4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:24.525590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45909b16-aaa1-4cd7-9260-c0e33e17dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.695700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45909b16-aaa1-4cd7-9260-c0e33e17dec4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:24.705564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:24.824451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:24.824973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.825257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.825535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.827180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.924987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:24.926635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4576317-560d-465a-a7b2-4db2211ae335 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:24.951918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 704/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:34.228630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:34.949309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:37.315912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8ae8-b3aa-478a-9936-6bc7f29444fa None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:37.316488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8ae8-b3aa-478a-9936-6bc7f29444fa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:37.316488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8ae8-b3aa-478a-9936-6bc7f29444fa None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:37.317919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 706/1410] 10.222.0.47 () {54 vars in 918 bytes} [Mon Oct 10 12:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:01:37.324283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeea8a9-7ea6-4493-bedf-7b1c69067aaa None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:37.324813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeea8a9-7ea6-4493-bedf-7b1c69067aaa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:37.324813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeea8a9-7ea6-4493-bedf-7b1c69067aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:37.401840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fdeea8a9-7ea6-4493-bedf-7b1c69067aaa None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:37.403014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fdeea8a9-7ea6-4493-bedf-7b1c69067aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:37.511942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 705/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Oct 10 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:37.526275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0730-5ce6-4591-b64b-529197b1e8c2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:37.526560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0730-5ce6-4591-b64b-529197b1e8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:37.526834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0730-5ce6-4591-b64b-529197b1e8c2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:37.528159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 707/1412] 10.222.0.47 () {54 vars in 918 bytes} [Mon Oct 10 12:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:37.533014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba5d4-98ba-4bc2-8ce5-57a26b868343 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:37.533300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba5d4-98ba-4bc2-8ce5-57a26b868343 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:37.533571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba5d4-98ba-4bc2-8ce5-57a26b868343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:37.605926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:37.609039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7f6ba5d4-98ba-4bc2-8ce5-57a26b868343 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:37.610295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7f6ba5d4-98ba-4bc2-8ce5-57a26b868343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:37.728682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 706/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Oct 10 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:40.350844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847362bf-c014-499f-94d4-ef2282581d18 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:40.351417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847362bf-c014-499f-94d4-ef2282581d18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:40.351417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847362bf-c014-499f-94d4-ef2282581d18 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:40.352721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:40.358157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358ed6e-a745-4803-8490-c43d0454585a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:40.358596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358ed6e-a745-4803-8490-c43d0454585a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:40.358743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358ed6e-a745-4803-8490-c43d0454585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:40.426906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9358ed6e-a745-4803-8490-c43d0454585a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:40.428155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9358ed6e-a745-4803-8490-c43d0454585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:40.486628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:40.529693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:40.822646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847362bf-c014-499f-94d4-ef2282581d18 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:40.824124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-847362bf-c014-499f-94d4-ef2282581d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:40.977416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847362bf-c014-499f-94d4-ef2282581d18 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:41.051320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:41.091508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:41.092029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:41.092304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:41.092569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:41.094176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:41.187432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:41.189035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409d1e-d414-4c5f-a51d-3cd8f238a401 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:41.207510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 709/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:42.370256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1352fa-c562-40e4-87f3-b8ee391350e2 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:42.370832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1352fa-c562-40e4-87f3-b8ee391350e2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:42.370832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1352fa-c562-40e4-87f3-b8ee391350e2 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:42.372179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:42.379047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580c84-9d24-4100-a5e9-45815b0d72ce None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:42.379548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580c84-9d24-4100-a5e9-45815b0d72ce None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:42.379642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580c84-9d24-4100-a5e9-45815b0d72ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:42.458234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d2580c84-9d24-4100-a5e9-45815b0d72ce None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:42.459477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d2580c84-9d24-4100-a5e9-45815b0d72ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:42.488385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:42.560033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:42.726966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1352fa-c562-40e4-87f3-b8ee391350e2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:42.728491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fc1352fa-c562-40e4-87f3-b8ee391350e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:42.879392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1352fa-c562-40e4-87f3-b8ee391350e2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:42.923171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:43.000417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:43.000947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:43.001226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:43.001496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:43.003125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:43.101204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:43.102876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d856-1d54-450c-a517-627c5450f1a5 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:43.123569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 709/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:44.263029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b19f-837f-40e6-adb9-b9cc9db11850 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:44.263611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b19f-837f-40e6-adb9-b9cc9db11850 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:44.263611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b19f-837f-40e6-adb9-b9cc9db11850 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:44.264919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:44.271406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a77b-aee4-4249-8844-98f649865ffc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:44.272395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a77b-aee4-4249-8844-98f649865ffc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:44.272511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a77b-aee4-4249-8844-98f649865ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:44.327581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:44.349947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b709a77b-aee4-4249-8844-98f649865ffc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:44.351680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b709a77b-aee4-4249-8844-98f649865ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:44.446473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:44.598236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b19f-837f-40e6-adb9-b9cc9db11850 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:44.599725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a977b19f-837f-40e6-adb9-b9cc9db11850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:44.745142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b19f-837f-40e6-adb9-b9cc9db11850 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:44.757940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:44.859356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:44.859871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:44.860146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:44.860419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:44.862303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:44.952937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:44.954571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68bacc-6640-43cd-8447-7846386f5b8b service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:44.973415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 712/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:46.106097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efbeff-d424-47a6-b67d-104deaca9f8e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:46.106701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efbeff-d424-47a6-b67d-104deaca9f8e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:46.106701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efbeff-d424-47a6-b67d-104deaca9f8e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:46.107995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:46.115370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95c7e1-0fe2-4236-99bc-5b91045b2037 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:46.115936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95c7e1-0fe2-4236-99bc-5b91045b2037 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:46.115936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95c7e1-0fe2-4236-99bc-5b91045b2037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:46.138191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:46.204694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8d95c7e1-0fe2-4236-99bc-5b91045b2037 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:46.206024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8d95c7e1-0fe2-4236-99bc-5b91045b2037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:46.308472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:46.460231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efbeff-d424-47a6-b67d-104deaca9f8e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:46.461756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-43efbeff-d424-47a6-b67d-104deaca9f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:46.575806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:46.612118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efbeff-d424-47a6-b67d-104deaca9f8e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:46.723749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:46.724269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:46.724544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:46.724850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:46.726465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:46.805188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:46.819205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:46.820929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379291d0-6530-4638-8ee8-3679d75b29be service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:46.839173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 712/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:47.943926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24cdc1-0530-4802-a553-8786139b354e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:47.944464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24cdc1-0530-4802-a553-8786139b354e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:47.944593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24cdc1-0530-4802-a553-8786139b354e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:47.945900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:47.952642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6b19-71c5-4a1d-8746-e8830d877816 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:47.953130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6b19-71c5-4a1d-8746-e8830d877816 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:47.953229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6b19-71c5-4a1d-8746-e8830d877816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:48.029484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7dab6b19-71c5-4a1d-8746-e8830d877816 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:48.030750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7dab6b19-71c5-4a1d-8746-e8830d877816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:48.133943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:48.286743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24cdc1-0530-4802-a553-8786139b354e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:48.289136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da24cdc1-0530-4802-a553-8786139b354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:48.404430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:48.468792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24cdc1-0530-4802-a553-8786139b354e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:48.582394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:48.582994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:48.583276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:48.583549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:48.585172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:48.634368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:48.674224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:48.675747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d66c93-721d-4768-8115-314d07bddf77 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:48.694275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 715/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:49.821940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57514c4-81ce-41fc-a1d7-185571a8d6ac None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:49.822465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57514c4-81ce-41fc-a1d7-185571a8d6ac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:49.822465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57514c4-81ce-41fc-a1d7-185571a8d6ac None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:49.823757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:49.830416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a39d4-e4e0-411a-ace6-bd35fc5ddf11 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:49.830876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a39d4-e4e0-411a-ace6-bd35fc5ddf11 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:49.831007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a39d4-e4e0-411a-ace6-bd35fc5ddf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:49.910232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b59a39d4-e4e0-411a-ace6-bd35fc5ddf11 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:49.911467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b59a39d4-e4e0-411a-ace6-bd35fc5ddf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:50.014732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:50.168126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57514c4-81ce-41fc-a1d7-185571a8d6ac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:50.169711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c57514c4-81ce-41fc-a1d7-185571a8d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:50.219297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:50.317528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57514c4-81ce-41fc-a1d7-185571a8d6ac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:50.431362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:50.431886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:50.432166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:50.432433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:50.434056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:50.440910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:50.527854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:50.529623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ef7c5-d9d5-4f4b-96ab-c9ed0152b3b2 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:50.548162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 715/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:51.667871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e755-d334-47d8-a00f-f610415b10af None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:51.668409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e755-d334-47d8-a00f-f610415b10af None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:51.668409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565e755-d334-47d8-a00f-f610415b10af None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:51.669760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:01:51.676445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14fe7d-b1f6-4288-a73d-27f93bbf81e0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:51.676962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14fe7d-b1f6-4288-a73d-27f93bbf81e0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:51.677113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14fe7d-b1f6-4288-a73d-27f93bbf81e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:51.758895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8d14fe7d-b1f6-4288-a73d-27f93bbf81e0 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:51.760035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8d14fe7d-b1f6-4288-a73d-27f93bbf81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:51.830559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:51.863899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:52.014092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e755-d334-47d8-a00f-f610415b10af None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:52.015521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9565e755-d334-47d8-a00f-f610415b10af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:52.034591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:52.182642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565e755-d334-47d8-a00f-f610415b10af None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:52.276053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:52.302462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:52.303061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:52.303336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:52.303603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:52.305183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:52.400097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:52.401701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3f9aa-2fbe-4e1e-b753-c24c7b4a648e service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:52.419798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 718/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:53.531752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed74401-0749-4110-996c-536bdc33c538 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:53.532297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed74401-0749-4110-996c-536bdc33c538 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:53.532297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed74401-0749-4110-996c-536bdc33c538 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:53.533682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:53.540822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fe4c6-ca02-435f-98ef-63fd2060847c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:53.541317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fe4c6-ca02-435f-98ef-63fd2060847c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:53.541424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fe4c6-ca02-435f-98ef-63fd2060847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:53.619926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4e6fe4c6-ca02-435f-98ef-63fd2060847c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:53.621157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4e6fe4c6-ca02-435f-98ef-63fd2060847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:53.664075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:53.721577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:53.872187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed74401-0749-4110-996c-536bdc33c538 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:53.873728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fed74401-0749-4110-996c-536bdc33c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:54.022528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed74401-0749-4110-996c-536bdc33c538 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:54.078245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:54.144829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:54.145436 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:54.145716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:54.146063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:54.147691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:54.238002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:54.239618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c574eb4-ca43-4351-b99c-3aa402af1274 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:54.258493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 718/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:55.371742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08b30-3956-42b0-a7bb-9faac1f63684 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:55.372273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08b30-3956-42b0-a7bb-9faac1f63684 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:55.372273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08b30-3956-42b0-a7bb-9faac1f63684 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:55.373581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:55.380212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba38f7-d37a-4eca-87e4-fbace7425d8e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:55.380702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba38f7-d37a-4eca-87e4-fbace7425d8e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:55.380800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba38f7-d37a-4eca-87e4-fbace7425d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:55.458456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-4bba38f7-d37a-4eca-87e4-fbace7425d8e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:55.459734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4bba38f7-d37a-4eca-87e4-fbace7425d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:55.459734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:55.564465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:55.715983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08b30-3956-42b0-a7bb-9faac1f63684 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:55.717493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b3d08b30-3956-42b0-a7bb-9faac1f63684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:55.869300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08b30-3956-42b0-a7bb-9faac1f63684 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:55.897185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:55.983187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:55.983707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:55.983986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:55.984257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:55.986131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:56.081085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:56.082742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204dac-f5e4-43e4-8a81-08e3d0ef7a96 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:56.101088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 721/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:58.191914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbdf1-4a99-4682-aa32-54a5e020587d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:58.192482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbdf1-4a99-4682-aa32-54a5e020587d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:58.192482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbdf1-4a99-4682-aa32-54a5e020587d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:58.193765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:01:58.199628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f4fa-c353-41ce-843a-0a57a6dc3ee3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:58.200100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f4fa-c353-41ce-843a-0a57a6dc3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:58.200201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15f4fa-c353-41ce-843a-0a57a6dc3ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:58.243556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:58.270970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-db15f4fa-c353-41ce-843a-0a57a6dc3ee3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:58.272276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-db15f4fa-c353-41ce-843a-0a57a6dc3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:58.370186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:58.653649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbdf1-4a99-4682-aa32-54a5e020587d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:58.655206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c32fbdf1-4a99-4682-aa32-54a5e020587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:58.761388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbdf1-4a99-4682-aa32-54a5e020587d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:58.794335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:58.837530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:58.838163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:58.838443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:58.838714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:58.840301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:58.949880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:58.951343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d325755-d293-4ff4-854f-f08979cdc303 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:58.969180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 721/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:01.271931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10324-a97e-431e-b055-53d4edae1677 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:01.272505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10324-a97e-431e-b055-53d4edae1677 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:01.272505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba10324-a97e-431e-b055-53d4edae1677 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:01.273804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:01.279982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af3165-17c8-4b5a-8a71-fd7f2b85c740 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:01.280393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af3165-17c8-4b5a-8a71-fd7f2b85c740 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:01.280563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af3165-17c8-4b5a-8a71-fd7f2b85c740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:01.346176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-91af3165-17c8-4b5a-8a71-fd7f2b85c740 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:01.347382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-91af3165-17c8-4b5a-8a71-fd7f2b85c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:01.360478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:01.448981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:01.729724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10324-a97e-431e-b055-53d4edae1677 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:01.731276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dba10324-a97e-431e-b055-53d4edae1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:01.843268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba10324-a97e-431e-b055-53d4edae1677 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:01.856834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:01.921565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:01.922194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:01.922475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:01.922748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:01.924339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:02.035064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:02.036422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780072-3b47-40c9-832f-496052e0879c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:02.057743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 724/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:04.609608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467a4e2-7b51-4684-9fad-69c94bb1f837 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:04.610588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467a4e2-7b51-4684-9fad-69c94bb1f837 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:04.610588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467a4e2-7b51-4684-9fad-69c94bb1f837 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:04.611789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:04.617813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eaef7-914f-4dde-83f5-d634ffe49d16 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:04.618302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eaef7-914f-4dde-83f5-d634ffe49d16 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:04.618401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eaef7-914f-4dde-83f5-d634ffe49d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:04.665796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:04.687336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-848eaef7-914f-4dde-83f5-d634ffe49d16 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:04.688604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-848eaef7-914f-4dde-83f5-d634ffe49d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:04.790643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:05.074779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467a4e2-7b51-4684-9fad-69c94bb1f837 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:05.076384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7467a4e2-7b51-4684-9fad-69c94bb1f837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:05.182199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467a4e2-7b51-4684-9fad-69c94bb1f837 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:05.222241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:05.257368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:05.257996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:05.258274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:05.258544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:05.260194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:05.374008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:05.375375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de474-d7ec-4f2a-8917-979f244bd3f0 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:05.393827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 724/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:07.682961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39168-3355-4be0-a574-ef12ad608273 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:07.683494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39168-3355-4be0-a574-ef12ad608273 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:07.683494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39168-3355-4be0-a574-ef12ad608273 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:07.684876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:07.690291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ffe55-6815-47e8-9a58-350af695de6f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:07.690737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ffe55-6815-47e8-9a58-350af695de6f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:07.690964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ffe55-6815-47e8-9a58-350af695de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:07.759128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-713ffe55-6815-47e8-9a58-350af695de6f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:07.760321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-713ffe55-6815-47e8-9a58-350af695de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:07.780767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:07.856356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:08.142529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39168-3355-4be0-a574-ef12ad608273 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:08.144061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0fa39168-3355-4be0-a574-ef12ad608273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:08.252318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39168-3355-4be0-a574-ef12ad608273 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:08.283222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:08.337097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:08.337696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:08.338002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:08.338276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:08.339841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:08.451181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:08.452636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8914272-8d32-45f1-ae50-221c7b15fe95 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:08.471946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 727/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:10.774354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb83c4-c1be-4dab-adb1-37660f3e3070 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:10.774869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb83c4-c1be-4dab-adb1-37660f3e3070 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:10.774869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb83c4-c1be-4dab-adb1-37660f3e3070 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:10.776250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:10.781580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d62f-57f9-45e8-9ed6-58e609c2c084 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:10.782033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d62f-57f9-45e8-9ed6-58e609c2c084 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:10.782163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d62f-57f9-45e8-9ed6-58e609c2c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:10.846114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:10.848724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ff70d62f-57f9-45e8-9ed6-58e609c2c084 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:10.850050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff70d62f-57f9-45e8-9ed6-58e609c2c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:10.947177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:11.229566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb83c4-c1be-4dab-adb1-37660f3e3070 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:11.231168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e4cb83c4-c1be-4dab-adb1-37660f3e3070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:11.336476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb83c4-c1be-4dab-adb1-37660f3e3070 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:11.386365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:11.411039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:11.412196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:11.412477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:11.412751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:11.414394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:11.528575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:11.529971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b76865-d823-4c36-b5d1-5a615dda2d2f service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:11.548983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 727/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:13.763265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ffe5-d9b2-470c-9c35-8fbc3d9de301 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.763797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ffe5-d9b2-470c-9c35-8fbc3d9de301 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.763797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ffe5-d9b2-470c-9c35-8fbc3d9de301 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.765115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:13.770479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557feb0-dbd8-407c-a168-582109244b38 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.771401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557feb0-dbd8-407c-a168-582109244b38 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.771551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557feb0-dbd8-407c-a168-582109244b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.839326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f557feb0-dbd8-407c-a168-582109244b38 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:13.840705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f557feb0-dbd8-407c-a168-582109244b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:13.870755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:13.939138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:14.221166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ffe5-d9b2-470c-9c35-8fbc3d9de301 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:14.222730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f733ffe5-d9b2-470c-9c35-8fbc3d9de301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:14.330348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ffe5-d9b2-470c-9c35-8fbc3d9de301 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:14.359746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:14.406341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:14.406948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:14.407249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:14.407505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:14.409096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:14.519672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:14.521040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48931fb2-b2ed-4d42-a196-8f64315597be service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:14.538738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 730/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:16.845091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c602e-3e02-407e-947b-05655d4b1ace None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:16.845627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c602e-3e02-407e-947b-05655d4b1ace None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:16.845627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c602e-3e02-407e-947b-05655d4b1ace None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:16.846932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:16.852314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa2eec-76db-4571-8083-f66d466c9cb3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:16.852765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa2eec-76db-4571-8083-f66d466c9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:16.852880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa2eec-76db-4571-8083-f66d466c9cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:16.924828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a1aa2eec-76db-4571-8083-f66d466c9cb3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:16.926076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1aa2eec-76db-4571-8083-f66d466c9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:16.934893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:17.023961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:17.306437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c602e-3e02-407e-947b-05655d4b1ace None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:17.308394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-580c602e-3e02-407e-947b-05655d4b1ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:17.411764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c602e-3e02-407e-947b-05655d4b1ace None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:17.467670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:17.487037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:17.487641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:17.487920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:17.488189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:17.489771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:17.599172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:17.600462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a5257-a481-4a8e-8c20-ba1fc77925f9 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:17.618786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 730/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:19.856334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d93c1-546a-4cc6-bfd7-ebeafb3aabff None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.856869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d93c1-546a-4cc6-bfd7-ebeafb3aabff None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.856869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d93c1-546a-4cc6-bfd7-ebeafb3aabff None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.858272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:19.864725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf5e3e-3093-4de6-9c33-d54e61d8a0b7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.865183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf5e3e-3093-4de6-9c33-d54e61d8a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.865430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf5e3e-3093-4de6-9c33-d54e61d8a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.937714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-06cf5e3e-3093-4de6-9c33-d54e61d8a0b7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:19.938987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-06cf5e3e-3093-4de6-9c33-d54e61d8a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:19.978541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:20.037362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:20.327666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d93c1-546a-4cc6-bfd7-ebeafb3aabff None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:20.329190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-483d93c1-546a-4cc6-bfd7-ebeafb3aabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:20.433145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d93c1-546a-4cc6-bfd7-ebeafb3aabff None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:20.474772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:20.511867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:20.512465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:20.512742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:20.513010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:20.514663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:20.624733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:20.626106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1a93e-9f99-4ddb-94a2-73dd4cd38719 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:20.644582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 733/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:02:22.829822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58f70-a131-4e06-bd3c-2b659570c79d None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:22.830395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58f70-a131-4e06-bd3c-2b659570c79d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:22.830518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58f70-a131-4e06-bd3c-2b659570c79d None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:22.831830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:22.837259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c873-5a66-488a-9669-ed1f4375f483 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:22.837692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c873-5a66-488a-9669-ed1f4375f483 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:22.837802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c873-5a66-488a-9669-ed1f4375f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:22.904534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ac11c873-5a66-488a-9669-ed1f4375f483 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:22.905766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ac11c873-5a66-488a-9669-ed1f4375f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:22.929739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:23.133263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:23.416807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58f70-a131-4e06-bd3c-2b659570c79d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:23.418388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c5e58f70-a131-4e06-bd3c-2b659570c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:23.525687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58f70-a131-4e06-bd3c-2b659570c79d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:23.592619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:23.599900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:23.609239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:23.609239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:23.609239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:23.609239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:23.712962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:23.714455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6cc37-7d17-4ba1-a8ef-7a80aa5aabfd service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:23.850931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 733/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:26.048933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0714-984c-405e-9f08-8818bb116e53 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:26.049500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0714-984c-405e-9f08-8818bb116e53 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:26.049500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d0714-984c-405e-9f08-8818bb116e53 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:26.050893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:26.057387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9442-59fb-43a4-9d96-a4ba7281ad29 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:26.057905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9442-59fb-43a4-9d96-a4ba7281ad29 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:26.058015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9442-59fb-43a4-9d96-a4ba7281ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:26.125757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0f0a9442-59fb-43a4-9d96-a4ba7281ad29 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:26.127021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0f0a9442-59fb-43a4-9d96-a4ba7281ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:26.177000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:26.227822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:26.521973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0714-984c-405e-9f08-8818bb116e53 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:26.523563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4a8d0714-984c-405e-9f08-8818bb116e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:26.636021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d0714-984c-405e-9f08-8818bb116e53 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:26.685963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:26.712142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:26.712675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:26.712953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:26.713256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:26.714880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:26.824692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:26.826161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161b57c-9ed4-4014-a518-06af82e262ea service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:26.844285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 736/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:36.225962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=22 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:36.842094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=66 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:46.982525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22dfa-fe2d-4a25-a137-96cb81af2314 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:46.983098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22dfa-fe2d-4a25-a137-96cb81af2314 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:46.983098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa22dfa-fe2d-4a25-a137-96cb81af2314 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:46.984652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 735/1471] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:46.990177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38336-fa15-41dc-8814-40ade78798ba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:46.998757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38336-fa15-41dc-8814-40ade78798ba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:46.998757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38336-fa15-41dc-8814-40ade78798ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:47.058316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ecb38336-fa15-41dc-8814-40ade78798ba None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:47.059541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ecb38336-fa15-41dc-8814-40ade78798ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:47.157213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 737/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:47.459198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805bca-4623-435f-bb1d-7ef1cf405a5c None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:47.459569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805bca-4623-435f-bb1d-7ef1cf405a5c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:47.459808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805bca-4623-435f-bb1d-7ef1cf405a5c None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:47.461125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 736/1473] 10.222.0.47 () {54 vars in 962 bytes} [Mon Oct 10 12:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:47.466725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c413af-8a42-43d6-a315-70c7a4850cfb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:47.467045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c413af-8a42-43d6-a315-70c7a4850cfb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:47.467319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c413af-8a42-43d6-a315-70c7a4850cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:47.542378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-27c413af-8a42-43d6-a315-70c7a4850cfb None None] MFA Rules not processed for user `0a1bda85ce4a41ed8ec354d40ecbb08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:47.543613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-27c413af-8a42-43d6-a315-70c7a4850cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:47.564210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:47.619902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 738/1474] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Oct 10 12:02:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:47.627618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24805bca-4623-435f-bb1d-7ef1cf405a5c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:47.629722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-24805bca-4623-435f-bb1d-7ef1cf405a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:47.734491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24805bca-4623-435f-bb1d-7ef1cf405a5c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:47.807447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:47.808060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:47.808339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:47.808602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:47.810206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:47.865408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:47.919271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:47.920708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba60ae-8a7d-4b17-9a4e-09cd3fa3d596 service glance] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:47.939144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 737/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:50.196946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2fcbb-4109-41db-8dd2-d89b1a488141 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:50.197491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2fcbb-4109-41db-8dd2-d89b1a488141 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:50.197491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2fcbb-4109-41db-8dd2-d89b1a488141 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:50.198879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 739/1476] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:50.204076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957c5e9-48ae-431e-a95a-472a132bcbb0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:50.204529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957c5e9-48ae-431e-a95a-472a132bcbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:50.204629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957c5e9-48ae-431e-a95a-472a132bcbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:50.272186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1957c5e9-48ae-431e-a95a-472a132bcbb0 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:50.273389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1957c5e9-48ae-431e-a95a-472a132bcbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:50.368451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 738/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:50.644520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2fcbb-4109-41db-8dd2-d89b1a488141 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:50.646266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bfd2fcbb-4109-41db-8dd2-d89b1a488141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:50.770206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2fcbb-4109-41db-8dd2-d89b1a488141 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:50.819531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:50.864966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:50.865595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:50.865898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:50.866175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:50.866815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:50.868578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:02:50.868578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:02:50.868578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:02:50.869716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33f720-1a08-4520-8d42-82a5e3a74bca admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:50.888665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 740/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Oct 10 12:02:50 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:02:53.031110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2bc31-591b-423a-a413-b75bcdfa155f None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:53.031657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2bc31-591b-423a-a413-b75bcdfa155f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:53.031657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2bc31-591b-423a-a413-b75bcdfa155f None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:53.032898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 739/1479] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:53.038297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f19cc8-1f4a-4ea6-975d-e88e446e002e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:53.038726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f19cc8-1f4a-4ea6-975d-e88e446e002e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:53.038860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f19cc8-1f4a-4ea6-975d-e88e446e002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:53.107770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-53f19cc8-1f4a-4ea6-975d-e88e446e002e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:53.109223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-53f19cc8-1f4a-4ea6-975d-e88e446e002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:53.207347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 741/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:53.500865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2bc31-591b-423a-a413-b75bcdfa155f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:53.502430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-88c2bc31-591b-423a-a413-b75bcdfa155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:53.512731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:53.648686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2bc31-591b-423a-a413-b75bcdfa155f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:53.728327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:53.761181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:53.761797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:53.762304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:53.762819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:53.764773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:53.855147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:53.856759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ced937-3583-4e49-9fe0-625ef7da4cb7 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:53.875119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 740/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:56.205757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2aa80-665f-4d18-9b6b-f0804f4d1bb3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:56.206184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2aa80-665f-4d18-9b6b-f0804f4d1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:56.206391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2aa80-665f-4d18-9b6b-f0804f4d1bb3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:56.207913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 742/1482] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:56.214232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7d73-e0cb-4e56-8817-051cb00435c8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:56.214727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7d73-e0cb-4e56-8817-051cb00435c8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:56.214841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7d73-e0cb-4e56-8817-051cb00435c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:56.282172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fb9b7d73-e0cb-4e56-8817-051cb00435c8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:56.283383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fb9b7d73-e0cb-4e56-8817-051cb00435c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:56.330161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:56.380668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 741/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:56.664929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2aa80-665f-4d18-9b6b-f0804f4d1bb3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:56.666565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-39d2aa80-665f-4d18-9b6b-f0804f4d1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:56.690942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:56.771377 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2aa80-665f-4d18-9b6b-f0804f4d1bb3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:56.850352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:56.850953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:56.851236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:56.851515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:56.853087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:56.926229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:56.960526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:56.961986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5912fba-8ed3-478d-b132-d6b0206b3735 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:56.981201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 743/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:59.173386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cd6bf-67d7-4c07-bc65-3893dab56d28 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:59.174072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cd6bf-67d7-4c07-bc65-3893dab56d28 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:59.174072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cd6bf-67d7-4c07-bc65-3893dab56d28 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:59.175300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 742/1485] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:59.181280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688a35-f16b-4b8d-adb9-623917d20b72 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:59.181693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688a35-f16b-4b8d-adb9-623917d20b72 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:59.181805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2688a35-f16b-4b8d-adb9-623917d20b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:59.247176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e2688a35-f16b-4b8d-adb9-623917d20b72 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:59.248371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e2688a35-f16b-4b8d-adb9-623917d20b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:59.342936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 744/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:02:59.636782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cd6bf-67d7-4c07-bc65-3893dab56d28 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:59.638339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d02cd6bf-67d7-4c07-bc65-3893dab56d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:59.742552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cd6bf-67d7-4c07-bc65-3893dab56d28 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:59.822117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:59.823738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:59.824363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:59.824642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:59.824912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:59.826635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:59.949041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:59.950519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274e116-245c-4f48-bb3b-82fc21c9c582 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:59.968897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 743/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:02.284067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966802-8c35-4943-87b2-d6c14dfea37e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:02.284629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966802-8c35-4943-87b2-d6c14dfea37e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:02.284629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966802-8c35-4943-87b2-d6c14dfea37e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:02.286732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 745/1488] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:03:02.292020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9d00-ffb6-4e7e-ae72-d1f89190e9ed None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:02.292504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9d00-ffb6-4e7e-ae72-d1f89190e9ed None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:02.292600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf9d00-ffb6-4e7e-ae72-d1f89190e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:02.359610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5cdf9d00-ffb6-4e7e-ae72-d1f89190e9ed None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:02.360825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5cdf9d00-ffb6-4e7e-ae72-d1f89190e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:02.414147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:02.459576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 744/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:02.749653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8966802-8c35-4943-87b2-d6c14dfea37e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:02.751222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8966802-8c35-4943-87b2-d6c14dfea37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:02.788337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:02.858434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8966802-8c35-4943-87b2-d6c14dfea37e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:02.935654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:02.936259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:02.936539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:02.936812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:02.938462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:03.020941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:03.050901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:03.053072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa769944-6358-4faf-a442-9cbc59329350 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:03.072386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 746/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:05.637244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40653d-8245-47a6-9a81-26061edd3697 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:05.637781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40653d-8245-47a6-9a81-26061edd3697 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:05.637781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40653d-8245-47a6-9a81-26061edd3697 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:05.639146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 745/1491] 10.222.0.47 () {54 vars in 927 bytes} [Mon Oct 10 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:03:05.644660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81b3ce-9399-4f3e-ba49-665763ee4f62 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:05.645664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81b3ce-9399-4f3e-ba49-665763ee4f62 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:05.645796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81b3ce-9399-4f3e-ba49-665763ee4f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:05.713311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6f81b3ce-9399-4f3e-ba49-665763ee4f62 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:05.714584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f81b3ce-9399-4f3e-ba49-665763ee4f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:05.810811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 747/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Mon Oct 10 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:06.098032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40653d-8245-47a6-9a81-26061edd3697 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:06.099574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a40653d-8245-47a6-9a81-26061edd3697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:06.204035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40653d-8245-47a6-9a81-26061edd3697 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:06.281592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:06.282319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:06.282602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:06.282877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:06.284498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:06.294540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:06.400680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:06.402062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b860c-3666-4cee-9b20-71651cdd08a3 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:06.430694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 746/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:15.809349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=82 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:16.428219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=50 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:28.418506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.418506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.418506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.494128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:28.495449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:28.591181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 748/1494] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:28.599195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.599688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.599794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.674658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:28.675762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:28.770966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 747/1495] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:28.775543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.776802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:28.788357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5e888-f513-4af0-8629-948a97cc5a3e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.850103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:28.883750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.884364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.884646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.884919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.885562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:04:28.885884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.886898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:28.886898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:04:28.886898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:04:28.887788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.899241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 749/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:04:28.907569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.917313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74147a6-977e-408e-aa8a-19a1213f5195 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.979223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:29.013690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.014326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.014606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.014878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.015510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.017235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:29.017235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:04:29.017235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:04:29.018755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.141224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 748/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:04:29.145465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:29.147031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.181877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed80c-ff53-42fd-86f9-0efac5396a0f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:29.275287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.275810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.276092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.276368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.277013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.278032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:29.278032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:04:29.278032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:04:29.279240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.377286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 750/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:04:29 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:04:29.381480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:29.383029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.445177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01216d-ece9-4cba-823f-930da1afa312 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:29.534336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:29.544720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.545338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.545617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.545908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.546552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.547574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:29.547574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:04:29.547574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:04:29.552927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.562222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 749/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:04:29.567020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:29.568393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.579952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec312d3-e687-41e0-8015-56298d4d9e19 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:29.605926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:29.679332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.679929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.680203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.680473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.681109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.682141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:29.682141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:04:29.682141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:04:29.683037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fec91-e4b8-48f4-8619-0649f3550a5d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.695947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 751/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:04:29.700251 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:29.701761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.734402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd88ec-04ec-419f-95f6-0da8b2f2d465 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:29.827396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.828001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.828277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.828546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] PATH_INFO: `/v3/projects/e30155a4487143a39c942dfd2e5ec8b4/users/5b956dfa01b847059d7ee55d8d21ea25/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.851494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30155a4487143a39c942dfd2e5ec8b4, user_id=5b956dfa01b847059d7ee55d8d21ea25, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.852522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:29.852522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:04:29.852522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:04:29.854502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936f229-e0e9-4b47-8b9e-43e0637068e0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.931800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 750/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:04:29 2022] PUT /identity/v3/projects/e30155a4487143a39c942dfd2e5ec8b4/users/5b956dfa01b847059d7ee55d8d21ea25/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:29.944839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbe44-4e86-4bd6-8115-7fbb84a56d4a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.952401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbe44-4e86-4bd6-8115-7fbb84a56d4a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.952401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbe44-4e86-4bd6-8115-7fbb84a56d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.004951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6f9bbe44-4e86-4bd6-8115-7fbb84a56d4a None None] MFA Rules not processed for user `5b956dfa01b847059d7ee55d8d21ea25`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:30.006208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f9bbe44-4e86-4bd6-8115-7fbb84a56d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.086756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 752/1502] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:30.099891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55280859-7cc5-468b-9b79-3cc726f60f05 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.100174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55280859-7cc5-468b-9b79-3cc726f60f05 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.100448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55280859-7cc5-468b-9b79-3cc726f60f05 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.101773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 751/1503] 10.222.0.47 () {54 vars in 963 bytes} [Mon Oct 10 12:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:04:30.106756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e5d28-3e45-40c8-b4f4-589fbd96a9e5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.107082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e5d28-3e45-40c8-b4f4-589fbd96a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.107360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e5d28-3e45-40c8-b4f4-589fbd96a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.139789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:30.184943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-421e5d28-3e45-40c8-b4f4-589fbd96a9e5 None None] MFA Rules not processed for user `b3e8ae06eace4634ac1a52ddab162d91`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:30.186209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-421e5d28-3e45-40c8-b4f4-589fbd96a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.262049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 753/1504] 10.222.0.47 () {58 vars in 1060 bytes} [Mon Oct 10 12:04:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:04:30.271820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55280859-7cc5-468b-9b79-3cc726f60f05 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:30.273333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-55280859-7cc5-468b-9b79-3cc726f60f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.323703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:30.378239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55280859-7cc5-468b-9b79-3cc726f60f05 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:30.451594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:30.452196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.452475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.452743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.454366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.557822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:30.559292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:30.562845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:30.577378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 752/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:30.623702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8d8fb-c7a5-48e6-8db0-697b743cff70 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.624120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8d8fb-c7a5-48e6-8db0-697b743cff70 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.624260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8d8fb-c7a5-48e6-8db0-697b743cff70 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.625512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 754/1506] 10.222.0.47 () {52 vars in 830 bytes} [Mon Oct 10 12:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:04:30.629123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:30.630318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.727467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c77415-d93a-403e-9b3c-063a25d5a81e service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:30.819487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:30.820122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.820404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.820679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] PATH_INFO: `/v3/users/5b956dfa01b847059d7ee55d8d21ea25` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.834035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b956dfa01b847059d7ee55d8d21ea25)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:30.835064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:30.835064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:04:30.835064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:04:30.836283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:30.845754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:31.038446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b956dfa01b847059d7ee55d8d21ea25'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:31.038852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b956dfa01b847059d7ee55d8d21ea25'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:31.061838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b956dfa01b847059d7ee55d8d21ea25'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:31.154064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b956dfa01b847059d7ee55d8d21ea25'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:31.154613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b956dfa01b847059d7ee55d8d21ea25'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:31.174336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 753/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:04:30 2022] DELETE /identity/v3/users/5b956dfa01b847059d7ee55d8d21ea25 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:31.178739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:31.179029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:31.179308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:31.236053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:31.237263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:31.314986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:31.328367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 755/1508] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:31.339149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:31.340452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:31.448129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b27de-c75c-4dae-898d-954f6e3ac314 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:31.505122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:31.524451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:31.525062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:31.525341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:31.525615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:31.527242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:31.636732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:31.638119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f848ec-8b0b-46f6-848c-136a0d3d49e6 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:31.656789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 754/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:32.152377 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:32.153598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:32.165772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4902ee-f0da-403b-930b-bbd48b704065 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:32.264715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:32.265354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:32.265631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:32.265926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] PATH_INFO: `/v3/projects/e30155a4487143a39c942dfd2e5ec8b4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:32.276481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30155a4487143a39c942dfd2e5ec8b4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:32.277545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:04:32.277545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:04:32.277545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:04:32.278831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:32.396242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30155a4487143a39c942dfd2e5ec8b4', 'request_id': 'req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:32.409292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30155a4487143a39c942dfd2e5ec8b4', 'request_id': 'req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:32.474427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30155a4487143a39c942dfd2e5ec8b4', 'request_id': 'req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:32.499977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] The token cache is being invalidate because project e30155a4487143a39c942dfd2e5ec8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:04:32.500271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:32.500701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2d50fe00-85ab-42eb-8dcd-bf931b32dc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:32.502185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 756/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:04:32 2022] DELETE /identity/v3/projects/e30155a4487143a39c942dfd2e5ec8b4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:41.654579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=62 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:42.497958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:12.872456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d6644-08a0-4c26-99d3-49592d8ac697 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.873027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d6644-08a0-4c26-99d3-49592d8ac697 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.873027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d6644-08a0-4c26-99d3-49592d8ac697 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.874312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:12.879495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a127d-0996-4686-a12e-1fb0fcff4f4c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.885487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a127d-0996-4686-a12e-1fb0fcff4f4c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.885487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a127d-0996-4686-a12e-1fb0fcff4f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.971480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-483a127d-0996-4686-a12e-1fb0fcff4f4c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:12.972720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-483a127d-0996-4686-a12e-1fb0fcff4f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:13.078380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:13.234284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d6644-08a0-4c26-99d3-49592d8ac697 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:13.236479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-253d6644-08a0-4c26-99d3-49592d8ac697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:13.354378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d6644-08a0-4c26-99d3-49592d8ac697 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:13.359727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d0d5-c5b8-4138-81da-cf036d2dfa28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:13.360319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d0d5-c5b8-4138-81da-cf036d2dfa28 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:13.360599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d0d5-c5b8-4138-81da-cf036d2dfa28 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:13.360873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d0d5-c5b8-4138-81da-cf036d2dfa28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:13.369609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d0d5-c5b8-4138-81da-cf036d2dfa28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:13.371227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d0d5-c5b8-4138-81da-cf036d2dfa28 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:13.380405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 756/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:14.102986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eede28b-ebf4-487c-8dc4-131ea746ebc2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.103583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eede28b-ebf4-487c-8dc4-131ea746ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.103583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eede28b-ebf4-487c-8dc4-131ea746ebc2 None None] PATH_INFO: `/v3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.105068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 758/1514] 10.222.0.43 () {54 vars in 925 bytes} [Mon Oct 10 12:06:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:06:14.112559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4dae-938c-4607-8c02-046e4cd148ad None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.112988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4dae-938c-4607-8c02-046e4cd148ad None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.113112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4dae-938c-4607-8c02-046e4cd148ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.174151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-326e4dae-938c-4607-8c02-046e4cd148ad None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:14.175367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-326e4dae-938c-4607-8c02-046e4cd148ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:14.244619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:14.249821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 757/1515] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Oct 10 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:06:14.460583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09840f-1e13-4583-b150-11e7e0dc963a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.460870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09840f-1e13-4583-b150-11e7e0dc963a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.461147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09840f-1e13-4583-b150-11e7e0dc963a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.462527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:14.469044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d29ac0-c870-4041-be9b-191a599867bd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.469353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d29ac0-c870-4041-be9b-191a599867bd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.469628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d29ac0-c870-4041-be9b-191a599867bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.491331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a5d29ac0-c870-4041-be9b-191a599867bd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:14.492532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a5d29ac0-c870-4041-be9b-191a599867bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:14.500553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:14.651002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09840f-1e13-4583-b150-11e7e0dc963a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.665635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09840f-1e13-4583-b150-11e7e0dc963a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.670979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858658b-618c-40df-b691-469c84609e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.671568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858658b-618c-40df-b691-469c84609e63 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.671847 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858658b-618c-40df-b691-469c84609e63 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.672124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858658b-618c-40df-b691-469c84609e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.680810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858658b-618c-40df-b691-469c84609e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.682436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858658b-618c-40df-b691-469c84609e63 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.691962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 760/1518] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:23.258250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d97a-812d-460b-8d17-c3ce451491d6 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.259037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d97a-812d-460b-8d17-c3ce451491d6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.259037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d97a-812d-460b-8d17-c3ce451491d6 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.260160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 759/1519] 10.222.0.47 () {54 vars in 961 bytes} [Mon Oct 10 12:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:23.265262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d3851-b892-410e-9075-5611c685f206 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.265665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d3851-b892-410e-9075-5611c685f206 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.265810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d3851-b892-410e-9075-5611c685f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.285723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f49d3851-b892-410e-9075-5611c685f206 None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:23.287712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f49d3851-b892-410e-9075-5611c685f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:23.296181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 761/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Oct 10 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:23.303605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d97a-812d-460b-8d17-c3ce451491d6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:23.316808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d97a-812d-460b-8d17-c3ce451491d6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:23.322197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151fe85-8adf-46d4-85fe-f1467691771d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:23.322777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151fe85-8adf-46d4-85fe-f1467691771d service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.323054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151fe85-8adf-46d4-85fe-f1467691771d service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.323323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151fe85-8adf-46d4-85fe-f1467691771d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.331540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151fe85-8adf-46d4-85fe-f1467691771d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:23.333132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151fe85-8adf-46d4-85fe-f1467691771d service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:23.343386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 760/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:06:26.171666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b428b0-8ab9-42d7-a09b-50620645130e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:26.172226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b428b0-8ab9-42d7-a09b-50620645130e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:26.172226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b428b0-8ab9-42d7-a09b-50620645130e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:26.173780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:26.179901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f40d-2dde-4815-a0dd-86a18852a139 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:26.180342 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f40d-2dde-4815-a0dd-86a18852a139 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:26.180489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995f40d-2dde-4815-a0dd-86a18852a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:26.199460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7995f40d-2dde-4815-a0dd-86a18852a139 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:26.200653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7995f40d-2dde-4815-a0dd-86a18852a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:26.208483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:26.362987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b428b0-8ab9-42d7-a09b-50620645130e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:26.377536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b428b0-8ab9-42d7-a09b-50620645130e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:26.384566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dfaaa-a034-4591-a4f6-ee6a6c4f21ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:26.387854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dfaaa-a034-4591-a4f6-ee6a6c4f21ed service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:26.387854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dfaaa-a034-4591-a4f6-ee6a6c4f21ed service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:26.387854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dfaaa-a034-4591-a4f6-ee6a6c4f21ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:26.394038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dfaaa-a034-4591-a4f6-ee6a6c4f21ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:26.395623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dfaaa-a034-4591-a4f6-ee6a6c4f21ed service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:26.405492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 763/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:27.472953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd12-f3eb-4e2e-8505-c6243fb59559 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:27.473469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd12-f3eb-4e2e-8505-c6243fb59559 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:27.473565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd12-f3eb-4e2e-8505-c6243fb59559 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:27.474867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 12:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:27.482312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36778-7a7f-45f4-9aec-40cb20f3fa00 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:27.482810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36778-7a7f-45f4-9aec-40cb20f3fa00 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:27.482904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36778-7a7f-45f4-9aec-40cb20f3fa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:27.502216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3fd36778-7a7f-45f4-9aec-40cb20f3fa00 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:27.503447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3fd36778-7a7f-45f4-9aec-40cb20f3fa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:27.511400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:27.661356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd12-f3eb-4e2e-8505-c6243fb59559 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:27.676447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd12-f3eb-4e2e-8505-c6243fb59559 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:27.681826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c990d4-4bbf-468d-8e19-c04821cdffd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:27.682455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c990d4-4bbf-468d-8e19-c04821cdffd4 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:27.682736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c990d4-4bbf-468d-8e19-c04821cdffd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:27.683039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c990d4-4bbf-468d-8e19-c04821cdffd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:27.691120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c990d4-4bbf-468d-8e19-c04821cdffd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:27.692697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c990d4-4bbf-468d-8e19-c04821cdffd4 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:27.702040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 763/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:31.687964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe3775-5fc0-4441-ae36-9cd13e38352c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:31.688533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe3775-5fc0-4441-ae36-9cd13e38352c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:31.688533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe3775-5fc0-4441-ae36-9cd13e38352c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:31.689874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:31.695223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464b6f-3a31-44d5-bf6f-41a816510fc7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:31.695645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464b6f-3a31-44d5-bf6f-41a816510fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:31.695870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10464b6f-3a31-44d5-bf6f-41a816510fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:31.715019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-10464b6f-3a31-44d5-bf6f-41a816510fc7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:31.716139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-10464b6f-3a31-44d5-bf6f-41a816510fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:31.723879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:32.014150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe3775-5fc0-4441-ae36-9cd13e38352c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:32.016634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b7fe3775-5fc0-4441-ae36-9cd13e38352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:32.050129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:32.095767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe3775-5fc0-4441-ae36-9cd13e38352c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:32.099462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29cde0-efb5-48e9-8ad1-c8cba73c54d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:32.100060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29cde0-efb5-48e9-8ad1-c8cba73c54d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:32.100343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29cde0-efb5-48e9-8ad1-c8cba73c54d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:32.100614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29cde0-efb5-48e9-8ad1-c8cba73c54d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:32.110386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29cde0-efb5-48e9-8ad1-c8cba73c54d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:32.111821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29cde0-efb5-48e9-8ad1-c8cba73c54d5 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:32.121206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 766/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:34.260381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639f52b-b4f5-417d-a25f-18c83988650e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:34.260913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639f52b-b4f5-417d-a25f-18c83988650e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:34.260913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639f52b-b4f5-417d-a25f-18c83988650e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:34.262316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:34.267479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c629-e755-4d11-9065-e9440c38043e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:34.267871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c629-e755-4d11-9065-e9440c38043e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:34.268117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c629-e755-4d11-9065-e9440c38043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:34.287406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bd64c629-e755-4d11-9065-e9440c38043e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:34.288551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd64c629-e755-4d11-9065-e9440c38043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:34.296513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:34.585350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639f52b-b4f5-417d-a25f-18c83988650e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:34.596128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639f52b-b4f5-417d-a25f-18c83988650e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:34.599689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9caab-c550-47c4-8803-22bb7d9e0aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:34.600287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9caab-c550-47c4-8803-22bb7d9e0aed service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:34.600567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9caab-c550-47c4-8803-22bb7d9e0aed service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:34.600839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9caab-c550-47c4-8803-22bb7d9e0aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:34.610384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9caab-c550-47c4-8803-22bb7d9e0aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:34.611814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9caab-c550-47c4-8803-22bb7d9e0aed service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:34.621715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 766/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:38.268758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464870de-7633-48d6-b351-6ff4d852d858 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:38.269329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464870de-7633-48d6-b351-6ff4d852d858 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:38.269329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464870de-7633-48d6-b351-6ff4d852d858 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:38.270685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:38.276527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fe00f-8a61-45c8-9e6d-bd59ff990b40 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:38.276977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fe00f-8a61-45c8-9e6d-bd59ff990b40 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:38.277096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fe00f-8a61-45c8-9e6d-bd59ff990b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:38.297090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-185fe00f-8a61-45c8-9e6d-bd59ff990b40 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:38.298271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-185fe00f-8a61-45c8-9e6d-bd59ff990b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:38.305957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:38.610898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464870de-7633-48d6-b351-6ff4d852d858 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:38.612562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-464870de-7633-48d6-b351-6ff4d852d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:38.693494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464870de-7633-48d6-b351-6ff4d852d858 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:38.697750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ed573-4c01-4b49-9d12-1a0b5ed5ec3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:38.703721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ed573-4c01-4b49-9d12-1a0b5ed5ec3b service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:38.703721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ed573-4c01-4b49-9d12-1a0b5ed5ec3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:38.703721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ed573-4c01-4b49-9d12-1a0b5ed5ec3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:38.707886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ed573-4c01-4b49-9d12-1a0b5ed5ec3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:38.709331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ed573-4c01-4b49-9d12-1a0b5ed5ec3b service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:38.719086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 769/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:40.844751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3d55-5ed7-4467-b62c-d99286e8d15e None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:40.845305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3d55-5ed7-4467-b62c-d99286e8d15e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:40.845305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3d55-5ed7-4467-b62c-d99286e8d15e None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:40.846582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:06:40.852460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f80fd-b5bf-445e-90d1-b5d152b6d8d1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:40.860355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f80fd-b5bf-445e-90d1-b5d152b6d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:40.860355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f80fd-b5bf-445e-90d1-b5d152b6d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:40.873505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b54f80fd-b5bf-445e-90d1-b5d152b6d8d1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:40.874758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b54f80fd-b5bf-445e-90d1-b5d152b6d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:40.882771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:41.180178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3d55-5ed7-4467-b62c-d99286e8d15e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:41.182044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c87d3d55-5ed7-4467-b62c-d99286e8d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:41.196059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3d55-5ed7-4467-b62c-d99286e8d15e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:41.199643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0218-6aa7-40be-ae1e-89b5e632b520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:41.200498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0218-6aa7-40be-ae1e-89b5e632b520 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:41.200777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0218-6aa7-40be-ae1e-89b5e632b520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:41.201050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0218-6aa7-40be-ae1e-89b5e632b520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:41.211871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e0218-6aa7-40be-ae1e-89b5e632b520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:41.220744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e0218-6aa7-40be-ae1e-89b5e632b520 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:41.223498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 769/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:50.869496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=63 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:51.218846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=37 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:23.087927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.090702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.092422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.142915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.146260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.169455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 771/1540] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.179167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.180785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.181593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.239898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.242788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.262965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 770/1541] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.269021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:23.296134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d59eae-1c25-4d66-a7e7-9b6086045cde None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:23.305361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:23.306977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.307801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.308576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.310123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:23.311036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:23.314814 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437791e-a9ec-463d-ae88-e26a6a39f5a0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:23.358112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 772/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:23.367738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:23.391438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8768a72-8f1b-46a8-b525-71dcf8ca6ed6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:23.407431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119240a-adca-404b-bcbf-212e57e081eb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.408012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119240a-adca-404b-bcbf-212e57e081eb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.408456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119240a-adca-404b-bcbf-212e57e081eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.409255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:23.411063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.411723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.412334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.417874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:23.417874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:23.447673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a119240a-adca-404b-bcbf-212e57e081eb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.449716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a119240a-adca-404b-bcbf-212e57e081eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.468398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 773/1543] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.470403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bcecd-0034-43ff-9025-67b102ee9c6f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.470921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bcecd-0034-43ff-9025-67b102ee9c6f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.471387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bcecd-0034-43ff-9025-67b102ee9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.530502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d17bcecd-0034-43ff-9025-67b102ee9c6f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.533317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d17bcecd-0034-43ff-9025-67b102ee9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.553599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 774/1544] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.555285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf03b-5282-47e3-a367-af21ce12da75 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.555824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf03b-5282-47e3-a367-af21ce12da75 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.556303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf03b-5282-47e3-a367-af21ce12da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.584362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-129cf03b-5282-47e3-a367-af21ce12da75 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.585999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-129cf03b-5282-47e3-a367-af21ce12da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.604672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 775/1545] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.605596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 771/1546] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/projects => generated 403 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:23.609766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f518e-1790-4e62-927d-e497b35016ea None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.609766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f518e-1790-4e62-927d-e497b35016ea None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.609766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f518e-1790-4e62-927d-e497b35016ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.612503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:23.645899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2c7f518e-1790-4e62-927d-e497b35016ea None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.645899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2c7f518e-1790-4e62-927d-e497b35016ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.767015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000e421-9c11-414e-a6a2-65a29bf16ed4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:23.786134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:23.786809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.787146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.787469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.788297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:23.788606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:23.789819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:08:23.789819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:08:23.789819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:08:23.790831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:23.818515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 772/1547] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:23.819509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:23.843184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e9b34-adec-478a-a5fb-cd56d1e51139 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:23.856421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:23.857061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.857338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.857600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.858433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:23.859567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:08:23.859567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:08:23.859567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:08:23.860903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:23.865374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 776/1548] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.868202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.874694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.875793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.935819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:23.938621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:23.952180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 777/1549] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:23.953042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:23.973416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c94875-4c32-49b9-bf30-28e7bb3d440c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:23.983305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:23.983944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:23.984225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:23.984739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:23.985412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:23.986492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:08:23.986492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:08:23.986492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:08:23.988807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.030222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 773/1550] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:24.032027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.058068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b6a2-e53b-4729-ab4b-f3e2d248667f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.072494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.073507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.074264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.074722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.077544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:24.077544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.080373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213150b-8d28-4861-9268-52fd906721d1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.137377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 774/1551] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:24.137377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e343f4-e17e-4c05-a965-013b065dd078 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.137377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e343f4-e17e-4c05-a965-013b065dd078 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.137377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e343f4-e17e-4c05-a965-013b065dd078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.138100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 778/1552] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:23 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:24.139812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.164750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-14e343f4-e17e-4c05-a965-013b065dd078 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.164750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-14e343f4-e17e-4c05-a965-013b065dd078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.340117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 775/1553] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.341583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.341945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.342224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.353201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719158f4-89a1-47b0-ac60-bc015e71058d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.358220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6514568-b7af-455e-a3b7-b35ba62e9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.358905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514568-b7af-455e-a3b7-b35ba62e9e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.359352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514568-b7af-455e-a3b7-b35ba62e9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.359633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6514568-b7af-455e-a3b7-b35ba62e9e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.360296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514568-b7af-455e-a3b7-b35ba62e9e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.362066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6514568-b7af-455e-a3b7-b35ba62e9e43 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.363513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.364753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.377160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 779/1555] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:24.377456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 776/1555] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.377581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.377581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.377581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.378519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.391197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f04f5-ace6-4a02-810a-e4dd8616cd4c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.399149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351aa243-0b7d-403e-93d3-cb99907b1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.400190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351aa243-0b7d-403e-93d3-cb99907b1f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.400668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351aa243-0b7d-403e-93d3-cb99907b1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.401125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351aa243-0b7d-403e-93d3-cb99907b1f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.402132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351aa243-0b7d-403e-93d3-cb99907b1f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.404877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.405595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351aa243-0b7d-403e-93d3-cb99907b1f6f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.406800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.419572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 780/1556] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.421534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.440445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e99a9-f289-484e-9a2b-53bf5e900c5b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.446016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f104cb-9429-4f16-a15b-1ed967129dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.446673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f104cb-9429-4f16-a15b-1ed967129dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.446956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f104cb-9429-4f16-a15b-1ed967129dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.447232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f104cb-9429-4f16-a15b-1ed967129dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.447923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f104cb-9429-4f16-a15b-1ed967129dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.450029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f104cb-9429-4f16-a15b-1ed967129dc6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.558179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:24.566066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 777/1557] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:24.571378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.571899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.572414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.598599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 781/1558] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:24.601085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.601525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.601936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.606501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.608503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.616535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:24.633060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.635105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.710481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 778/1559] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.715413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.722776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ad1b8-0f62-47b1-aa81-49367f55a473 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.725305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 782/1560] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.727295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.730924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.731959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.732424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.732893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.734230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:24.734756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.736814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee367d2-7bd0-4d3a-a85c-8d92d4bea569 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.743075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bf489-2394-4626-84d5-1d82122cf1e8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.750562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc6e71-259f-4d91-a612-a3bf93c0d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.751628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6e71-259f-4d91-a612-a3bf93c0d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.752123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6e71-259f-4d91-a612-a3bf93c0d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.752641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6e71-259f-4d91-a612-a3bf93c0d9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.754490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6e71-259f-4d91-a612-a3bf93c0d9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.757734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6e71-259f-4d91-a612-a3bf93c0d9c3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.767170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 779/1561] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:24.767170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.767170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.767170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.780888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 783/1562] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:24.780888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.781217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.781436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.801435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.803643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.815362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.816990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.818231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 780/1563] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.819686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.829663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 784/1564] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.830498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.839241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b319bca-2947-4558-a5ab-e29b3ba86331 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.844154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7040bba-ec7d-451d-a4ff-c4e02e37dc34 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.845237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.846082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.846503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.846947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.848235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.850036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0d511-ffa5-412b-9fab-b012c3ce2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.850518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.851071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0d511-ffa5-412b-9fab-b012c3ce2016 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.851429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0d511-ffa5-412b-9fab-b012c3ce2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.851779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0d511-ffa5-412b-9fab-b012c3ce2016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.852515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0d511-ffa5-412b-9fab-b012c3ce2016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.854262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0d511-ffa5-412b-9fab-b012c3ce2016 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.866550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 785/1565] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:24.868014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405941-58d0-43b4-b687-4e3a68ccc285 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.868378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405941-58d0-43b4-b687-4e3a68ccc285 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.868725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405941-58d0-43b4-b687-4e3a68ccc285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.889634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aa405941-58d0-43b4-b687-4e3a68ccc285 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.890918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aa405941-58d0-43b4-b687-4e3a68ccc285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.899299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 786/1566] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.900587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.900875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.901149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.922444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:24.923696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:24.932779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 787/1567] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:24.933672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.943662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa895-1e84-46fb-a9ae-b14ddec1c86e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.947224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 781/1568] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:24.948626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.952543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.952658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:24.952743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.952743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.952743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.952743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:24.959922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00261560-a98b-481a-a972-e16aed4d794f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:24.965253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:24.965878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:24.966168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:24.966446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] PATH_INFO: `/v3/projects/4819f74980e64314b1c360bb24e388a2/users/cfb1886b0ef24eee896f2381b14b513a/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:24.982828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4819f74980e64314b1c360bb24e388a2, user_id=cfb1886b0ef24eee896f2381b14b513a, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:24.985524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.053672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 788/1569] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:24 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:25.053672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.088438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 782/1570] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:24 2022] PUT /identity/v3/projects/4819f74980e64314b1c360bb24e388a2/users/cfb1886b0ef24eee896f2381b14b513a/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:25.093900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.131784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c370-0810-4edc-b7a3-2a9417cb56b2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.182965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d434e-7643-4a82-865c-f1a2caa51847 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.187928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.188804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.189140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:25.189594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.189987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.190871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:25.191282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.193607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.202902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.203480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.204217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.204504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.205184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:25.205467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.207101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.207227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 783/1571] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:25.208027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.219706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef8523-f8cf-411c-ab64-011c22d20f16 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.225389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.226471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.226751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.227024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.227676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.228223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 789/1572] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:25.229199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.229369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.240160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc32e9-5bcd-4b7a-87e1-661127bdadd1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.245198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.245809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.246131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.246407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.247049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:25.247416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.247895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 784/1573] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:25.248794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.249019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.260211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d6c9f-84ea-43a4-8b78-23f9a59cf25e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.270016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 790/1574] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:25.270016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.270836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.271786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.272074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.272349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.273062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:25.273319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.275013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.282484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a95623-d137-4ef6-a404-7375a3f98dc0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.286633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8687ae9-e739-44e7-8ade-bcd8b9196b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.287282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8687ae9-e739-44e7-8ade-bcd8b9196b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.287564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8687ae9-e739-44e7-8ade-bcd8b9196b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.287997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8687ae9-e739-44e7-8ade-bcd8b9196b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.288625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8687ae9-e739-44e7-8ade-bcd8b9196b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.290285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8687ae9-e739-44e7-8ade-bcd8b9196b2c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.294158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 785/1575] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:25.295004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.303063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 791/1576] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:25.304486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.304894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.305273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.309097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90ad6d-f293-4798-8d37-9ef82136d57d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.314412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.315373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.315708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.315952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.317245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.319473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.327529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:25.328958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:25.330340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:25.341928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 792/1577] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:25.343916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.355436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae33c00-84bc-4da6-bc53-b79e4ddd20ae None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.360519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.361152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.361691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.374309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.374309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.374309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.489648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 786/1578] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:25 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:25.489648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.501182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260ac37-0341-4aac-bafb-87f99a4d05ab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.504235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 793/1579] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:25.505115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.592076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.593210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.593689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.594172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.595309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.599128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528aef7-d9b9-477d-9269-82f35a7271a3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.599638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.604306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.605003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.605369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.605649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] PATH_INFO: `/v3/projects/37cd0347d9cd4b9cbfa90653f033cbcc/users/33a0401f0b9d4a33afc87c794cd681d4/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.625483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cd0347d9cd4b9cbfa90653f033cbcc, user_id=33a0401f0b9d4a33afc87c794cd681d4, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.626821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:08:25.626821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:08:25.626821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:08:25.629101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.694177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 787/1580] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:25.695218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.728024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 794/1581] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:25 2022] PUT /identity/v3/projects/37cd0347d9cd4b9cbfa90653f033cbcc/users/33a0401f0b9d4a33afc87c794cd681d4/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:25.728024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.767742 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2df97-b66f-41d6-b3b0-61ad419782ba admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.804256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a1d4-ca25-46ab-a0ea-8e544f20f932 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:25.809761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.810562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.810965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.811317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.812170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.814424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.830689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:25.831313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:25.831598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:25.831930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:25.832571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:25.834699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:25.932600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:25.944021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 795/1582] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:25.944021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.962035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 788/1583] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:25 2022] POST /identity/v3/projects => generated 393 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:25.962035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:25.968434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:26.018236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd406-3617-456f-9a12-d4cf4855d6a8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.056097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b27cf-f958-4728-af0f-6ce470606bf9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.061942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.062943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.063429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.063871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.090758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.091813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.092324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.092845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.094142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.098313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.118386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 796/1584] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.119947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.134650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.135700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88615226-31bf-49ad-91c9-d8c338c7aba7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.136119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.140849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.142428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.142428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.142428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.142943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.144957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.147870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 789/1585] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:26.148560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.159837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 797/1586] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.159837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.160680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c501f-8642-4e6e-84e2-263900f948a2 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.164370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.165006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.165292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.165570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.166248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.169059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.173717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618d15c-d209-4b5a-b558-d493e971d40f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.181483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676143-2d98-4d57-baad-0c58410c02ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.182309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676143-2d98-4d57-baad-0c58410c02ef admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.182589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676143-2d98-4d57-baad-0c58410c02ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.183083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676143-2d98-4d57-baad-0c58410c02ef admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.183713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676143-2d98-4d57-baad-0c58410c02ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.185736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676143-2d98-4d57-baad-0c58410c02ef admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.287856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 798/1587] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:26 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:26.287856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.288612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 790/1588] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:26 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:26.288723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.288823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.289469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.304119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c521b-7c8b-400d-9822-8d26e992bc18 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.310559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.312059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.312960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.313573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:26.313810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.314989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.315134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:26.319490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.327999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 799/1589] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:26.339853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.344838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8a16f-3588-437a-8e90-1781bcd9f69d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.350039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.351056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.351426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.352588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.352588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.354350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.444659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 791/1590] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:26 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:26.445529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.455587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7dd4c-f9b5-4614-991a-8f910c1b7e80 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.460902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.461601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.461917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.462197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] PATH_INFO: `/v3/projects/20608580b8034688a67de5e54184e70f/users/448ab3cbfff647198991719e8f7ade84/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.481489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20608580b8034688a67de5e54184e70f, user_id=448ab3cbfff647198991719e8f7ade84, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.481765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 800/1591] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:26 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:26.482486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.487137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.495901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730146f3-1f02-4bdf-aae0-8becdc0c3db8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.502930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.504602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.505108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.505596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.506843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.510074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.531470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 801/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.532948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.556850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343cd79-50f1-4684-b77d-235f6a83b4e0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.563752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 792/1593] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:26 2022] PUT /identity/v3/projects/20608580b8034688a67de5e54184e70f/users/448ab3cbfff647198991719e8f7ade84/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:26.565097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.605039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:26.631523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.632132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.632412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.632692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.633340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.635013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.652664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 802/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.654295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.659076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:26.663480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a16e-4ba1-4a71-bd65-2a4eed942837 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.668338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.668794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.669055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.669330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.670085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.671713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.689715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 793/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.691282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.709993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a15a6-e70e-48cc-a4ca-5a1e475d1fb8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.718994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.719942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.720468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.720924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.722181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.724846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.727571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d6293-72e2-4f7f-956c-60cac96d0d31 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.732631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.733313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.733604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.733883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.744651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 794/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.747630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.747780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.749828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.760697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db4ba8-b92e-4573-850b-9467314bda8a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.761554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 803/1597] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:26.762503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.766226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ea06-a4e6-4c31-b16b-678a41803bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.766978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ea06-a4e6-4c31-b16b-678a41803bec admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.767248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ea06-a4e6-4c31-b16b-678a41803bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.767675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ea06-a4e6-4c31-b16b-678a41803bec admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.768032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88ea06-a4e6-4c31-b16b-678a41803bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.769716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88ea06-a4e6-4c31-b16b-678a41803bec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.774025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fff9-0128-4eb8-a6fc-2156d1ae4d29 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:26.780175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:26.786331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.786331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.786331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] PATH_INFO: `/v3/projects/6210cf21017f4c5292921c414260143b/users/24087520ce51429e94d2498965fc432f/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.786642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 795/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:26.786642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:26.786642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:26.786642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:26.812396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6210cf21017f4c5292921c414260143b, user_id=24087520ce51429e94d2498965fc432f, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:26.817459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:26.845054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] MFA Rules not processed for user `448ab3cbfff647198991719e8f7ade84`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:26.846383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:26.935935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 796/1599] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:26.937444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.938447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 804/1600] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:26 2022] PUT /identity/v3/projects/6210cf21017f4c5292921c414260143b/users/24087520ce51429e94d2498965fc432f/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:26.939783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:26.974835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819acd36-b403-4920-a8af-9e624b47ec13 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.101460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.102208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.109223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.109223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.109223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.109223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.111532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f524a6-b119-4da1-95d4-11b829484852 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.117987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 797/1601] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:27.118301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.118586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:27.122498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.122780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.123054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.123973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.125793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.130276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b6b5b-edbd-4fdd-971e-3b0576e913ab admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.135589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c8e3e-f9f4-4e3a-b339-4feb822c1222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.136227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c8e3e-f9f4-4e3a-b339-4feb822c1222 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.139443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c8e3e-f9f4-4e3a-b339-4feb822c1222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.139443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c8e3e-f9f4-4e3a-b339-4feb822c1222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.139443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c8e3e-f9f4-4e3a-b339-4feb822c1222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.139443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c8e3e-f9f4-4e3a-b339-4feb822c1222 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.142101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 805/1602] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:27.142999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:27.152678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 798/1603] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:27.154185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.154421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.154854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.164197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c60aa4-1457-4e5b-92ac-05a3fae9f19f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.174630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994fcd-9bf7-4ec9-9c36-80e12965ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.176491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994fcd-9bf7-4ec9-9c36-80e12965ac30 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.177170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994fcd-9bf7-4ec9-9c36-80e12965ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.177616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994fcd-9bf7-4ec9-9c36-80e12965ac30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.178806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994fcd-9bf7-4ec9-9c36-80e12965ac30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.181156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994fcd-9bf7-4ec9-9c36-80e12965ac30 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.204959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 806/1604] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:27.208568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e8df-3d03-42d0-8f23-81fbbe9b173a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.208568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e8df-3d03-42d0-8f23-81fbbe9b173a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.208816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e8df-3d03-42d0-8f23-81fbbe9b173a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.215825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] MFA Rules not processed for user `24087520ce51429e94d2498965fc432f`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.218413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:27.219556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 807/1605] 10.222.0.47 () {54 vars in 961 bytes} [Mon Oct 10 12:08:27 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:08:27.221192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e8df-3d03-42d0-8f23-81fbbe9b173a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:27.247015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e8df-3d03-42d0-8f23-81fbbe9b173a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.253460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.255131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.255131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.255131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] PATH_INFO: `/v3/projects/6e2eefe1169a4f9eafa9708b3ec62314/users/df1f64397b6e4dbeb1f39d1a27b3da3d/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.275719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2eefe1169a4f9eafa9708b3ec62314, user_id=df1f64397b6e4dbeb1f39d1a27b3da3d, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.277674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:27.278870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.335551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 799/1606] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:27.337077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:27.351492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af868c9-bfe9-43cf-abaa-4d9f2a13f839 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.359397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.360008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.365265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.365265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] PATH_INFO: `/v3/projects/bd2f99641c254d22a9f01f467677254d/users/3699fc29c57d46948c756ecdeffee190/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.368551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 808/1607] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:27 2022] PUT /identity/v3/projects/6e2eefe1169a4f9eafa9708b3ec62314/users/df1f64397b6e4dbeb1f39d1a27b3da3d/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:27.370462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:27.388802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2f99641c254d22a9f01f467677254d, user_id=3699fc29c57d46948c756ecdeffee190, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.399602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:27.413156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.483978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17da96-f57c-4f06-a93a-b6318ba99fc5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.489082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be478d2f-f78d-41d5-a108-d925b89f86c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.489770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be478d2f-f78d-41d5-a108-d925b89f86c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.490233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be478d2f-f78d-41d5-a108-d925b89f86c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.490510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be478d2f-f78d-41d5-a108-d925b89f86c7 admin admin] PATH_INFO: `/v3/projects/1f87609975f14c369e08266a96672500/users/3dd437f4be4c4c6788bd1968a302537b/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.509404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be478d2f-f78d-41d5-a108-d925b89f86c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f87609975f14c369e08266a96672500, user_id=3dd437f4be4c4c6788bd1968a302537b, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.512264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be478d2f-f78d-41d5-a108-d925b89f86c7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.539866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 800/1608] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:27 2022] PUT /identity/v3/projects/bd2f99641c254d22a9f01f467677254d/users/3699fc29c57d46948c756ecdeffee190/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:27.541252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:27.623700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840135b3-4369-4a58-a63f-737529277474 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:27.632042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bfa14-507a-4cf8-aea5-dec46c9d19a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:27.632042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfa14-507a-4cf8-aea5-dec46c9d19a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.632042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfa14-507a-4cf8-aea5-dec46c9d19a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.632042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bfa14-507a-4cf8-aea5-dec46c9d19a0 admin admin] PATH_INFO: `/v3/projects/0a6b935b47fc41b7bd5f83e60ffcdb0b/users/1416ea3d97ef4396ab8975a4d43bbdca/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.645076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfa14-507a-4cf8-aea5-dec46c9d19a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6b935b47fc41b7bd5f83e60ffcdb0b, user_id=1416ea3d97ef4396ab8975a4d43bbdca, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:27.647825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bfa14-507a-4cf8-aea5-dec46c9d19a0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:27.666844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 809/1609] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:27 2022] PUT /identity/v3/projects/1f87609975f14c369e08266a96672500/users/3dd437f4be4c4c6788bd1968a302537b/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:27.666844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e247-c15d-46fa-b414-8afc5e0492d6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.666844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e247-c15d-46fa-b414-8afc5e0492d6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.666844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914e247-c15d-46fa-b414-8afc5e0492d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.704192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2914e247-c15d-46fa-b414-8afc5e0492d6 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.718087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2914e247-c15d-46fa-b414-8afc5e0492d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:27.755390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 801/1610] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:27 2022] PUT /identity/v3/projects/0a6b935b47fc41b7bd5f83e60ffcdb0b/users/1416ea3d97ef4396ab8975a4d43bbdca/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:27.764142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a9bc-b6ae-4edb-ac33-68f673e3be55 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.764142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a9bc-b6ae-4edb-ac33-68f673e3be55 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.764142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0a9bc-b6ae-4edb-ac33-68f673e3be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.779934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 810/1611] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:27.781055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a6307-47bc-4194-8389-de6ea34207ab None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.781348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a6307-47bc-4194-8389-de6ea34207ab None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.781604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a6307-47bc-4194-8389-de6ea34207ab None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.782754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8fe0a9bc-b6ae-4edb-ac33-68f673e3be55 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.784504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8fe0a9bc-b6ae-4edb-ac33-68f673e3be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:27.788406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 811/1612] 10.222.0.47 () {54 vars in 961 bytes} [Mon Oct 10 12:08:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:08:27.789708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503f43-8f85-4ca8-96c4-357fc7f72bf4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.790019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503f43-8f85-4ca8-96c4-357fc7f72bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.790296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa503f43-8f85-4ca8-96c4-357fc7f72bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.824357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fa503f43-8f85-4ca8-96c4-357fc7f72bf4 None None] MFA Rules not processed for user `3699fc29c57d46948c756ecdeffee190`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.825664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fa503f43-8f85-4ca8-96c4-357fc7f72bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:27.868293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 802/1613] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:27.871711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.871711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.871711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.910138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] MFA Rules not processed for user `3dd437f4be4c4c6788bd1968a302537b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.911513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:27.922974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 812/1614] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:27.924477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453c9c-563a-43e5-ae13-e00bf328b85f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.924859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453c9c-563a-43e5-ae13-e00bf328b85f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.925226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453c9c-563a-43e5-ae13-e00bf328b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.949916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ad453c9c-563a-43e5-ae13-e00bf328b85f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.949916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ad453c9c-563a-43e5-ae13-e00bf328b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:27.960281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 813/1615] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:27.961315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:27.961484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:27.961752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:27.963126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:27.983928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:27.985280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:28.045515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 803/1616] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:28.047382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.069691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:28.097137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 814/1617] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Oct 10 12:08:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:28.098076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.165076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f4b18-2ca8-476d-9cfa-e9d804747e20 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.168801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.169419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.169697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.170025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.180242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:28.181713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:28.192075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 815/1618] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:28.193408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.200689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c1d2-9925-43c5-aab8-06fb2f1cd1ae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.203978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9d8b9-3ee5-4023-9496-8dafa5bfc93d service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.208395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af5c63-3442-494c-9b5d-802a0ba9e061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.209033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5c63-3442-494c-9b5d-802a0ba9e061 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.209318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5c63-3442-494c-9b5d-802a0ba9e061 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.209508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.209679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5c63-3442-494c-9b5d-802a0ba9e061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.210422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.210882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.211081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.211586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:28.213756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:28.296291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5c63-3442-494c-9b5d-802a0ba9e061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:28.298129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5c63-3442-494c-9b5d-802a0ba9e061 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:28.308423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 804/1619] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:28.309704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.310021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.310428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.341475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] MFA Rules not processed for user `cfb1886b0ef24eee896f2381b14b513a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:28.342666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:28.419300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 816/1620] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:28 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:28.422892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.468825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 805/1621] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:28.469669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.476496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:28.601261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba68b2-1475-4c07-a86d-d9545160a0b5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.608710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52969c2-9730-44bc-8022-0e00abbc37e4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.614489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.615807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.616202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.616795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.667573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.668207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.668490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.668765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.702130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:28.759613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:28.759613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:28.787321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 817/1622] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:28.788675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.838724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:28.841426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:28.854337 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 806/1623] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:28.855564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:28.878747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36589163-27e8-41e0-8899-08c16c3c6995 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.885010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.885774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.886187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.887054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:28.887529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:28.890405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:28.921007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac5b6-f7b7-490d-bf24-0f31507360c6 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:28.927627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73514113-e13b-4dc6-b9c7-0c70d2b9e1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:28.928305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73514113-e13b-4dc6-b9c7-0c70d2b9e1af service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:28.936464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73514113-e13b-4dc6-b9c7-0c70d2b9e1af service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:28.936464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73514113-e13b-4dc6-b9c7-0c70d2b9e1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.032128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 807/1624] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:28 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:29.033040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.052160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73514113-e13b-4dc6-b9c7-0c70d2b9e1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.055515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73514113-e13b-4dc6-b9c7-0c70d2b9e1af service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.056070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90e1a-e77c-46d9-8e29-7b65a2e96a5f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.066611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:29.067248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.071694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.072056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.072760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.075110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.077114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 818/1625] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:29.078818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172618bc-42ca-4f6c-9036-4e216f616740 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.079207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172618bc-42ca-4f6c-9036-4e216f616740 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.079578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172618bc-42ca-4f6c-9036-4e216f616740 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.081421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 819/1626] 10.222.0.47 () {54 vars in 912 bytes} [Mon Oct 10 12:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:08:29.083074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172618bc-42ca-4f6c-9036-4e216f616740 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.097217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172618bc-42ca-4f6c-9036-4e216f616740 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.104660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6299c58-280c-4999-b852-afae4f1144c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:29.105381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299c58-280c-4999-b852-afae4f1144c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.105760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299c58-280c-4999-b852-afae4f1144c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.106208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6299c58-280c-4999-b852-afae4f1144c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.107726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6299c58-280c-4999-b852-afae4f1144c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.109516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6299c58-280c-4999-b852-afae4f1144c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.452045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 820/1627] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:29.452045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.452045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.452045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.452045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:29.452045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:29.456786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 821/1628] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:29.456786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.456786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30929aab-fa2e-4d1a-9636-05e3129851f1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.456786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:29.457927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.457927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.457927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] PATH_INFO: `/v3/projects/d796283cffac486ba4c9d2ac89637f29/users/91b4c20aea684f27a29d518feb62005c/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.457927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796283cffac486ba4c9d2ac89637f29, user_id=91b4c20aea684f27a29d518feb62005c, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.457927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.461956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 808/1629] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:29 2022] POST /identity/v3/projects => generated 403 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:29.461956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.461956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:29.485250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55fc5-b496-427a-813c-0d1bfb8b9b08 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.495555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc7899-bf7b-491a-9e42-3368d09c3dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:29.496393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7899-bf7b-491a-9e42-3368d09c3dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.497018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7899-bf7b-491a-9e42-3368d09c3dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.497394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7899-bf7b-491a-9e42-3368d09c3dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.550510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 822/1630] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:29 2022] PUT /identity/v3/projects/d796283cffac486ba4c9d2ac89637f29/users/91b4c20aea684f27a29d518feb62005c/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:29.552587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.614643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc7899-bf7b-491a-9e42-3368d09c3dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.616316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc7899-bf7b-491a-9e42-3368d09c3dd1 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.631948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 809/1631] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:29.633544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ec0d-a412-4f74-b354-1247936adb56 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.634209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ec0d-a412-4f74-b354-1247936adb56 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.634423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325ec0d-a412-4f74-b354-1247936adb56 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.635928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 810/1632] 10.222.0.47 () {54 vars in 912 bytes} [Mon Oct 10 12:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:08:29.636748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ec0d-a412-4f74-b354-1247936adb56 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.660702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2233b34-2cf7-4d21-bfef-3a866536d343 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.681312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:29.681975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.682684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.702025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.702025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.702025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.745456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325ec0d-a412-4f74-b354-1247936adb56 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.751309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdf814-e113-4714-bb5f-fa9f74bae317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:29.755597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdf814-e113-4714-bb5f-fa9f74bae317 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.755597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdf814-e113-4714-bb5f-fa9f74bae317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.755597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdf814-e113-4714-bb5f-fa9f74bae317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.755597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdf814-e113-4714-bb5f-fa9f74bae317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:29.755597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdf814-e113-4714-bb5f-fa9f74bae317 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:29.774939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 811/1633] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:29.774939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:29.774939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:29.774939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:29.802535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:29.803967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:29.930514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 812/1634] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:08:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:29.941343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.959132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 823/1635] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:29 2022] POST /identity/v3/users => generated 308 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:29.965660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:29.999401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e7574-6e05-4a85-9c6f-96bb6246f688 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:29.999480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c49ca-391f-485d-ab54-0ba6550d47bb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:30.004921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:30.005993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:30.007109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:30.007262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6444a0-b983-42ee-a21d-da1d193cd71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:30.008007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6444a0-b983-42ee-a21d-da1d193cd71a admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:30.008375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6444a0-b983-42ee-a21d-da1d193cd71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:30.008652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6444a0-b983-42ee-a21d-da1d193cd71a admin admin] PATH_INFO: `/v3/projects/d796283cffac486ba4c9d2ac89637f29/users/91b4c20aea684f27a29d518feb62005c/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:30.008800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:30.009733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:30.017624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6444a0-b983-42ee-a21d-da1d193cd71a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796283cffac486ba4c9d2ac89637f29, user_id=91b4c20aea684f27a29d518feb62005c, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:30.025657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:30.027674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6444a0-b983-42ee-a21d-da1d193cd71a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:30.061538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 813/1636] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:29 2022] PUT /identity/v3/projects/d796283cffac486ba4c9d2ac89637f29/users/91b4c20aea684f27a29d518feb62005c/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:30.081246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:30.110139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:30.110139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:30.110664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 824/1637] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:08:30.111631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:30.127914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b833a8-fe55-4e03-8e3e-6e02667c3c09 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:30.147008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] MFA Rules not processed for user `91b4c20aea684f27a29d518feb62005c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:30.147903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:30.311006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:30.312493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:30.314928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:30.315626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] PATH_INFO: `/v3/projects/71fa3a4776e8431a932c9721c8eb178e/users/9e7f4d2779f74faaa4c08a2fbf3cd936/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:30.335141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 814/1638] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:08:30.355512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fa3a4776e8431a932c9721c8eb178e, user_id=9e7f4d2779f74faaa4c08a2fbf3cd936, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:30.358391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:30.463327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:30.543950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 825/1639] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:30 2022] PUT /identity/v3/projects/71fa3a4776e8431a932c9721c8eb178e/users/9e7f4d2779f74faaa4c08a2fbf3cd936/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:08:30.548415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:30.561200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04953a-d5c0-41ee-bbc1-c473d1696639 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:30.641733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:30.642616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:30.642904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:30.643641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:30.643908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:30.645649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:30.657610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 815/1640] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:30.661918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:30.673170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18007a4a-dc4b-4e77-b1e8-df4bb10a38f7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:30.679803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:30.681290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:30.682248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:30.682577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] PATH_INFO: `/v3/projects/71fa3a4776e8431a932c9721c8eb178e/users/9e7f4d2779f74faaa4c08a2fbf3cd936/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:30.684934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fa3a4776e8431a932c9721c8eb178e, user_id=9e7f4d2779f74faaa4c08a2fbf3cd936, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:30.688165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:30.713491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 826/1641] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:30 2022] PUT /identity/v3/projects/71fa3a4776e8431a932c9721c8eb178e/users/9e7f4d2779f74faaa4c08a2fbf3cd936/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:31.043219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:31.152932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4924ec-ce38-4c8c-8a91-44a893904b6d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:31.256112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:31.256903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:31.257199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:31.257482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:31.303149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:31.320907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe9a8e-d5b3-4c73-9882-f1885f3210b8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:31.333200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f10ac-9795-4f69-b3db-d8718d97d165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:31.333840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f10ac-9795-4f69-b3db-d8718d97d165 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:31.334323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f10ac-9795-4f69-b3db-d8718d97d165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:31.334607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f10ac-9795-4f69-b3db-d8718d97d165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:31.377743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:31.379947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:31.397164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 816/1642] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:31.539062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f10ac-9795-4f69-b3db-d8718d97d165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:31.540705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f10ac-9795-4f69-b3db-d8718d97d165 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:31.554744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 827/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:08:31.992655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:32.393053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:32.414256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e59c0d-7195-42c8-8b8d-7595b8afee63 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:32.424562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:32.426032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:32.426744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:32.427471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:32.596792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:32.600194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:32.606686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:32.619644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 817/1644] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:32.859802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:33.254743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5c4e-18a9-4736-b97d-46b7bd939cb1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:33.255079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5c4e-18a9-4736-b97d-46b7bd939cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:33.255358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e5c4e-18a9-4736-b97d-46b7bd939cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:33.310872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-335e5c4e-18a9-4736-b97d-46b7bd939cb1 None None] MFA Rules not processed for user `9e7f4d2779f74faaa4c08a2fbf3cd936`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:33.314578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-335e5c4e-18a9-4736-b97d-46b7bd939cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:33.558427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 828/1645] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:35.527827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:35.731140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:35.752837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ae66b-b266-4d7a-9076-6ba5bb3fd5d4 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:35.781430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:35.782290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:35.782820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:35.784062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] PATH_INFO: `/v3/users/448ab3cbfff647198991719e8f7ade84` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:35.788917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448ab3cbfff647198991719e8f7ade84)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:35.790740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:35.964484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c27ec-4ab7-4e97-9e30-b311e89223d3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:35.965365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c27ec-4ab7-4e97-9e30-b311e89223d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:35.965365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c27ec-4ab7-4e97-9e30-b311e89223d3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:35.966513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 829/1646] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:08:36.087329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:36.087616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:36.087966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:36.143107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:36.164844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:36.210500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448ab3cbfff647198991719e8f7ade84'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:36.211876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448ab3cbfff647198991719e8f7ade84'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:36.246930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448ab3cbfff647198991719e8f7ade84'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:36.404253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448ab3cbfff647198991719e8f7ade84'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:36.405899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-71432529-aac2-4a75-9fbc-5a1448852078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448ab3cbfff647198991719e8f7ade84'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:36.461601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 818/1647] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:35 2022] DELETE /identity/v3/users/448ab3cbfff647198991719e8f7ade84 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:36.468042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:36.468042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:36.468283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:36.478711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 830/1648] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:36.507504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:36.521289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:36.650791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:36.654104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:36.684789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 819/1649] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:36.700732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e17b3f-336d-4a28-8a81-2c6be97da122 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:36.761881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:36.763535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:36.854334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:36.855828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:36.855828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:36.856780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:36.882860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:36.884711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:36.920334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 831/1650] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:08:36.923672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952ee5-478c-433a-a040-bbf5b36918e8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:36.928461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:36.929372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:36.930134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:36.930665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:36.944308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:36.947099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:36.960120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 820/1651] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:08:37.849255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:37.851516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:37.884756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb0f0-b0b8-4ccd-8a2b-f2b7b748ee40 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:37.899119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:37.900530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:37.901441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:37.903197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] PATH_INFO: `/v3/users/cfb1886b0ef24eee896f2381b14b513a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:37.906077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb1886b0ef24eee896f2381b14b513a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:37.908750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:08:37.908750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Oct 10 12:08:37.908750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: Oct 10 12:08:37.915142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:37.921274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:38.250754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb1886b0ef24eee896f2381b14b513a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:38.252131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb1886b0ef24eee896f2381b14b513a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:38.280806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb1886b0ef24eee896f2381b14b513a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:38.313524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb1886b0ef24eee896f2381b14b513a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:38.405635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7eeae93a-1216-4c9a-969f-7379d3458c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb1886b0ef24eee896f2381b14b513a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:38.418507 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 832/1652] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:37 2022] DELETE /identity/v3/users/cfb1886b0ef24eee896f2381b14b513a => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:38.625366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:38.627483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:38.680607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad69b0-832f-4cd5-9488-e6b0b6566116 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:38.716757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:38.829329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:38.830931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:38.831921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:38.832335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] PATH_INFO: `/v3/projects/20608580b8034688a67de5e54184e70f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:38.833997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20608580b8034688a67de5e54184e70f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:38.835248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: WARNING py.warnings [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 12:08:38.835248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: warnings.warn(msg) Oct 10 12:08:38.835248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: Oct 10 12:08:38.836928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:38.993939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20608580b8034688a67de5e54184e70f', 'request_id': 'req-b317c57d-8bac-422d-b8b2-3f391bc2400d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:39.020411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20608580b8034688a67de5e54184e70f', 'request_id': 'req-b317c57d-8bac-422d-b8b2-3f391bc2400d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:39.130960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20608580b8034688a67de5e54184e70f', 'request_id': 'req-b317c57d-8bac-422d-b8b2-3f391bc2400d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:39.161711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] The token cache is being invalidate because project 20608580b8034688a67de5e54184e70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:39.162275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:39.183592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b317c57d-8bac-422d-b8b2-3f391bc2400d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:39.183592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 821/1653] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:38 2022] DELETE /identity/v3/projects/20608580b8034688a67de5e54184e70f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:39.183758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:39.183758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:39.183758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:39.231172 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:39.232511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:39.402760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 833/1654] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:08:39.411980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:39.412262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:39.412559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:39.496387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:39.500789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:39.525632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:39.528235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 822/1655] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:39.577490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49de7f7-98e1-4f41-8c08-754860841e94 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:39.604919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:39.605684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:39.606162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:39.606944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:39.607124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:39.607576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:39.609141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:39.637772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 834/1656] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:08:39.642008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:39.653794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3eb9c-3460-4896-aa64-84fc6ababa5b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:39.660361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:39.661374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:39.661801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:39.662303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:39.663304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:39.665750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:39.749644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:39.751630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:39.783291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33709dc0-54f4-49db-9f56-6a65ca701aa9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:39.798287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:39.799897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:39.801606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:39.802237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] PATH_INFO: `/v3/projects/4819f74980e64314b1c360bb24e388a2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:39.804176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 823/1657] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:39 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:39.806913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4819f74980e64314b1c360bb24e388a2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:39.810985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:39.814602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:40.036920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4819f74980e64314b1c360bb24e388a2', 'request_id': 'req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.067571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4819f74980e64314b1c360bb24e388a2', 'request_id': 'req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.142629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ccdd9-5b69-4453-8944-8ec84bf0a799 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:40.172882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4819f74980e64314b1c360bb24e388a2', 'request_id': 'req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.175970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:40.192458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] The token cache is being invalidate because project 4819f74980e64314b1c360bb24e388a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:40.193333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.194158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.197123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 835/1658] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:39 2022] DELETE /identity/v3/projects/4819f74980e64314b1c360bb24e388a2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:40.202231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:40.211295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:40.405568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfc448-fcfd-42bd-ac2f-6849f5aefdbb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:40.417128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:40.417872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:40.418166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:40.424262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] PATH_INFO: `/v3/users/9e7f4d2779f74faaa4c08a2fbf3cd936` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:40.429691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7f4d2779f74faaa4c08a2fbf3cd936)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:40.430950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:40.431856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:40.432406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:40.432910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:40.434014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:40.437076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:40.444927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:40.580017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 824/1659] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:39 2022] POST /identity/v3/users => generated 286 bytes in 769 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:40.581105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:40.583807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:40.598421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c727421-15d8-4653-890f-e6be795df4a7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:40.615451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:40.617395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:40.617395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:40.617395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] PATH_INFO: `/v3/users/24087520ce51429e94d2498965fc432f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:40.618503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24087520ce51429e94d2498965fc432f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:40.620683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:40.777458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7f4d2779f74faaa4c08a2fbf3cd936'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.780787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7f4d2779f74faaa4c08a2fbf3cd936'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.805724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7f4d2779f74faaa4c08a2fbf3cd936'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.857597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7f4d2779f74faaa4c08a2fbf3cd936'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.861346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24087520ce51429e94d2498965fc432f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.863751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24087520ce51429e94d2498965fc432f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.902470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24087520ce51429e94d2498965fc432f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.977641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7f4d2779f74faaa4c08a2fbf3cd936'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:40.990668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 836/1660] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:40 2022] DELETE /identity/v3/users/9e7f4d2779f74faaa4c08a2fbf3cd936 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:40.991643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:40.993205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:41.074161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24087520ce51429e94d2498965fc432f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:41.074799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3e6043f1-a997-475e-b3cd-fb8c52ce21c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24087520ce51429e94d2498965fc432f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:41.113630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 825/1661] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:40 2022] DELETE /identity/v3/users/24087520ce51429e94d2498965fc432f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:41.123517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.123810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.124091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.240862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:41.246649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:41.247904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:41.296975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260bd2d-3f9d-4078-b3f4-38e9ac4c34c1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:41.451270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 826/1662] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:41.489305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:41.490883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:41.526322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083d65-63b7-4714-9d7b-8f2421f3647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:41.528257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083d65-63b7-4714-9d7b-8f2421f3647e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.528417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083d65-63b7-4714-9d7b-8f2421f3647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.529990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083d65-63b7-4714-9d7b-8f2421f3647e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.536037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6083d65-63b7-4714-9d7b-8f2421f3647e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:41.540982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6083d65-63b7-4714-9d7b-8f2421f3647e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:41.582367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 837/1663] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:41.583865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f5dc-833a-4d7a-a47c-725e763bc428 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.584159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f5dc-833a-4d7a-a47c-725e763bc428 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.584436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f5dc-833a-4d7a-a47c-725e763bc428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.651137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ee62f5dc-833a-4d7a-a47c-725e763bc428 None None] MFA Rules not processed for user `33a0401f0b9d4a33afc87c794cd681d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:41.652182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ee62f5dc-833a-4d7a-a47c-725e763bc428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:41.655708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ba8ed-6e55-4279-aa0b-67d51b57d4fb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:41.664958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:41.665609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.665913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.666190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.691221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:41.696556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:41.742249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 827/1664] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:08:41.747545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:41.770839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:41.795594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57cc0-94b6-46e8-9c10-3f764cda91b5 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:41.804479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:41.805391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.805823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.806286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.807118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:41.808933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:41.826232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 838/1665] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:41.835631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.835918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.836243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.841085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 828/1666] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:41.845162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:41.863973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc328dc-b9bd-421c-9ac4-e543cf7feff6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:41.880619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] MFA Rules not processed for user `33a0401f0b9d4a33afc87c794cd681d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:41.884681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:41.888811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb92cc5-9e0c-40cf-9e83-56b6f08f2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:41.890340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb92cc5-9e0c-40cf-9e83-56b6f08f2dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:41.890783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb92cc5-9e0c-40cf-9e83-56b6f08f2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:41.891246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb92cc5-9e0c-40cf-9e83-56b6f08f2dc9 admin admin] PATH_INFO: `/v3/projects/a92339522c834cb59c3daa2424891d31/users/b47c2bc1383a40b1b0670cfe429e6842/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:41.903409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 839/1667] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:08:41.927274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb92cc5-9e0c-40cf-9e83-56b6f08f2dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92339522c834cb59c3daa2424891d31, user_id=b47c2bc1383a40b1b0670cfe429e6842, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:41.932321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb92cc5-9e0c-40cf-9e83-56b6f08f2dc9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:41.932464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:41.939563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:42.077749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 829/1668] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:41 2022] PUT /identity/v3/projects/a92339522c834cb59c3daa2424891d31/users/b47c2bc1383a40b1b0670cfe429e6842/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:42.080902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:42.081326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:42.081680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:42.111564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a25a4f-405b-4db8-99a8-4b962c0b12c9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:42.177024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] MFA Rules not processed for user `b47c2bc1383a40b1b0670cfe429e6842`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:42.178603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:42.223236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:42.224259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:42.224683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:42.225112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:42.278997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:42.343382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 830/1669] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:08:42.349801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:42.358958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:42.366383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:42.392127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 840/1670] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:42.438838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:42.441439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:42.616390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfefe9-3a0e-496a-9412-8f0bc2995329 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:42.629529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:42.630305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:42.630691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:42.631041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] PATH_INFO: `/v3/projects/71fa3a4776e8431a932c9721c8eb178e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:42.633697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fa3a4776e8431a932c9721c8eb178e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:42.635875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:42.663012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b4d95-92d6-42bf-9caf-d7ac22240a76 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:42.685488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:42.687335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:42.688110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:42.694068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:42.694068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:42.701557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:42.887412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 831/1671] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:42 2022] POST /identity/v3/projects => generated 373 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:42.891897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:42.892892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fa3a4776e8431a932c9721c8eb178e', 'request_id': 'req-8c952eae-e510-4672-9f60-17717298e3e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:42.909513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fa3a4776e8431a932c9721c8eb178e', 'request_id': 'req-8c952eae-e510-4672-9f60-17717298e3e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:43.020836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fa3a4776e8431a932c9721c8eb178e', 'request_id': 'req-8c952eae-e510-4672-9f60-17717298e3e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:43.039347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] The token cache is being invalidate because project 71fa3a4776e8431a932c9721c8eb178e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:43.040405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:43.042852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8c952eae-e510-4672-9f60-17717298e3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:43.046288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 841/1672] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:42 2022] DELETE /identity/v3/projects/71fa3a4776e8431a932c9721c8eb178e => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:08:43.051512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b70da7-b474-4c76-9524-05fff013da51 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.054378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b70da7-b474-4c76-9524-05fff013da51 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.054981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b70da7-b474-4c76-9524-05fff013da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.069604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47030fd9-9b19-4df5-a05c-0f0a47ad5c0e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:43.085592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:43.086609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.087049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.088985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.100588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:43.100588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:43.106627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-51b70da7-b474-4c76-9524-05fff013da51 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:43.110863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-51b70da7-b474-4c76-9524-05fff013da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:43.158056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 842/1673] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:43.163785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.164313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.164687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.208199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:43.215095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:43.222874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:43.232458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 843/1674] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:43.233033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:43.250976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87111c34-1544-4a87-a66b-8c9d9c72c1f2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:43.261019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:43.262339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.262903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.263731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.265256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:43.268325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:43.279833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6fe03-7929-4bd4-ad5f-dacdde24a202 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:43.305754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 844/1675] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:43.307714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270332f1-3803-452c-937e-f865884df469 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.308478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270332f1-3803-452c-937e-f865884df469 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.309081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270332f1-3803-452c-937e-f865884df469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.330500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 832/1676] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:42 2022] POST /identity/v3/users => generated 293 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:43.335002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:43.368643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e8294-e954-402f-94e7-561a44711e47 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:43.387585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-270332f1-3803-452c-937e-f865884df469 None None] MFA Rules not processed for user `df1f64397b6e4dbeb1f39d1a27b3da3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:43.388891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-270332f1-3803-452c-937e-f865884df469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:43.407786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:43.410524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.415588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.415878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.417153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:43.419550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:43.533995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 833/1677] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:43 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:43.535590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:43.546079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:43.590662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 845/1678] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:43.592113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270332f1-3803-452c-937e-f865884df469 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:43.593791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-270332f1-3803-452c-937e-f865884df469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:43.645740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270332f1-3803-452c-937e-f865884df469 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:43.775204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ce32-4896-4c1f-89e8-dfdb2f347195 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:43.795476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:43.797185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.799688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.800487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.802233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:43.804662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:43.812514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:43.813580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.816851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.819580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] PATH_INFO: `/v3/projects/6210cf21017f4c5292921c414260143b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.823019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6210cf21017f4c5292921c414260143b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:43.830060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:43.839251 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 834/1679] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:43.844580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:43.876105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aa0e1-1dca-42c8-a522-7a31802cf8b4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:43.887805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:43.889141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:43.896060 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:43.896585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:43.897903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:43.909416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:44.058979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 835/1680] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:43 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:44.068572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:44.076156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:44.080157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6210cf21017f4c5292921c414260143b', 'request_id': 'req-df081f3e-4206-43fb-ae7c-fdd882e39f33'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:44.097625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6210cf21017f4c5292921c414260143b', 'request_id': 'req-df081f3e-4206-43fb-ae7c-fdd882e39f33'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:44.181375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6210cf21017f4c5292921c414260143b', 'request_id': 'req-df081f3e-4206-43fb-ae7c-fdd882e39f33'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:44.253298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] The token cache is being invalidate because project 6210cf21017f4c5292921c414260143b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:44.255070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:44.258115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:44.269589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 846/1681] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:43 2022] DELETE /identity/v3/projects/6210cf21017f4c5292921c414260143b => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:44.273629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:44.275978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:44.325965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff40b5-6916-44f8-b31d-58c0619df6c8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:44.498302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:44.499078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:44.499227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:44.499574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:44.502065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:44.572801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df081f3e-4206-43fb-ae7c-fdd882e39f33 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:44.578997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:44.580866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:44.583083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:44.590936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] PATH_INFO: `/v3/projects/074863dbe652447389470e71cc1b5d01/users/251bd9f7a7584b2781d4df4ecd8e3a3c/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:44.634870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=074863dbe652447389470e71cc1b5d01, user_id=251bd9f7a7584b2781d4df4ecd8e3a3c, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:44.645113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:44.649935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:44.673369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:44.677733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:44.697324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 836/1682] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:44.698968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:44.700560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:44.716002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83553f88-66d1-447f-add7-edc323fd0ff7 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:44.722361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185fc53-1e68-44ce-9ec0-ce4c25e82324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:44.723642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185fc53-1e68-44ce-9ec0-ce4c25e82324 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:44.723642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185fc53-1e68-44ce-9ec0-ce4c25e82324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:44.723642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185fc53-1e68-44ce-9ec0-ce4c25e82324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:44.724384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185fc53-1e68-44ce-9ec0-ce4c25e82324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:44.726417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185fc53-1e68-44ce-9ec0-ce4c25e82324 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:44.746529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 837/1683] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:44.748683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a815ea8-bbaa-461b-ad5f-8f99e69a0b45 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:44.749180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a815ea8-bbaa-461b-ad5f-8f99e69a0b45 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:44.749689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a815ea8-bbaa-461b-ad5f-8f99e69a0b45 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:44.756950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 838/1685] 10.222.0.47 () {54 vars in 912 bytes} [Mon Oct 10 12:08:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:08:44.759399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00b1c9-6f7e-4f18-bc4e-e506a6d46755 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:44.759836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 847/1685] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:44 2022] PUT /identity/v3/projects/074863dbe652447389470e71cc1b5d01/users/251bd9f7a7584b2781d4df4ecd8e3a3c/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:44.760143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00b1c9-6f7e-4f18-bc4e-e506a6d46755 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:44.760565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00b1c9-6f7e-4f18-bc4e-e506a6d46755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:44.761269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:44.795557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9a00b1c9-6f7e-4f18-bc4e-e506a6d46755 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:44.801660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9a00b1c9-6f7e-4f18-bc4e-e506a6d46755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:44.952244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 839/1686] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:44.952244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:44.952244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:44.952244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:44.991797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb1083-9339-4468-a4b3-a6116796a485 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:45.007880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:45.009497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.012410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.012921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.015360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:45.017955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:45.047746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 848/1687] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:45.047746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:45.055559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] MFA Rules not processed for user `aa49e174aaa14829a0281441a834ef4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:45.059301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:45.070524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d6025-6329-46c4-8d63-66cf71481690 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:45.079623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e77afc-adcb-44d4-95be-2bc68384d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:45.080348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e77afc-adcb-44d4-95be-2bc68384d64b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.080707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e77afc-adcb-44d4-95be-2bc68384d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.080981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e77afc-adcb-44d4-95be-2bc68384d64b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.081692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e77afc-adcb-44d4-95be-2bc68384d64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:45.083909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e77afc-adcb-44d4-95be-2bc68384d64b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:45.102486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 849/1688] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:45.105836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.106155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.106459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.148289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:45.149590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:45.189641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 850/1689] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:45.193035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:45.206618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5df06-1810-44b0-8fa9-41fa67d0a83e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:45.239140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:45.239840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.242262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.245319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] PATH_INFO: `/v3/projects/6eac6ea41f2a4f2cae06b0e633f94cc2/users/1b08977199e94a3d836b4737b3c381f4/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.279271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 840/1690] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:08:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:45.286911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eac6ea41f2a4f2cae06b0e633f94cc2, user_id=1b08977199e94a3d836b4737b3c381f4, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:45.287447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:45.289655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:45.323192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42194d-76e8-45a4-a46b-7749e19137a7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:45.343652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:45.344828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.345114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.345392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] PATH_INFO: `/v3/projects/074863dbe652447389470e71cc1b5d01/users/251bd9f7a7584b2781d4df4ecd8e3a3c/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.365371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=074863dbe652447389470e71cc1b5d01, user_id=251bd9f7a7584b2781d4df4ecd8e3a3c, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:45.366076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:45.389089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 841/1691] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:45 2022] PUT /identity/v3/projects/074863dbe652447389470e71cc1b5d01/users/251bd9f7a7584b2781d4df4ecd8e3a3c/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:45.394995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:45.441225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 851/1692] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:45 2022] PUT /identity/v3/projects/6eac6ea41f2a4f2cae06b0e633f94cc2/users/1b08977199e94a3d836b4737b3c381f4/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:45.442143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:45.454773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:45.545529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:45.646540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae93a77-5d36-4d52-a767-73f06e94a349 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:45.651441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:45.720231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a989b8-6d60-43dc-adc3-b72d08649320 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:45.735622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9fdf6-82e5-4d3a-ac03-d1cf765f0c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:45.737812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9fdf6-82e5-4d3a-ac03-d1cf765f0c81 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.738506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9fdf6-82e5-4d3a-ac03-d1cf765f0c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.738982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9fdf6-82e5-4d3a-ac03-d1cf765f0c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.752707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9fdf6-82e5-4d3a-ac03-d1cf765f0c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:45.756758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9fdf6-82e5-4d3a-ac03-d1cf765f0c81 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:45.772789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 852/1693] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:45.778059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.778555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.778951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.832937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] MFA Rules not processed for user `251bd9f7a7584b2781d4df4ecd8e3a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:45.834836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:45.856464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:45.857128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.857413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.857690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:45.858868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:45.859327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:45.862034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a977784-371b-4ae9-a66c-0a1808d8a6df admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:45.904092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 842/1694] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:45.904092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:45.904092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:45.904092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.012550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] MFA Rules not processed for user `1b08977199e94a3d836b4737b3c381f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:46.018250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:46.140830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 853/1695] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:46.141713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:46.192720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d925-e944-409f-9c1e-33eb734a95fc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:46.212544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 843/1696] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:46.216922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:46.218056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:46.226937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa66a72-e663-4ef0-8912-9cd29cc8eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:46.228842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa66a72-e663-4ef0-8912-9cd29cc8eceb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.229701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa66a72-e663-4ef0-8912-9cd29cc8eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.232062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa66a72-e663-4ef0-8912-9cd29cc8eceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.238840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa66a72-e663-4ef0-8912-9cd29cc8eceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:46.241991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa66a72-e663-4ef0-8912-9cd29cc8eceb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:46.359030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d161a-6982-488f-8924-20df985a1cd2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:46.359030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:46.359030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.359030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.359544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.379353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:46.382496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:46.398997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 844/1697] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:46.400128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:46.416916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f53c21-ce57-4c12-ada2-eee16d7f99a8 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:46.426846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:46.429353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.429831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.430365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.430493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 854/1698] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:46 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:46.432568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:46.435791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:46.437751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.443370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.454270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.514202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] MFA Rules not processed for user `1416ea3d97ef4396ab8975a4d43bbdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:46.515529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:46.584057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 845/1699] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:46 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:46.585236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:46.638612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 855/1700] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:46.644068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:46.759385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befed96-a9a4-433c-8915-5cc0973070e4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:46.764783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b812-d765-4fc3-a23a-aebddb70eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:46.765618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b812-d765-4fc3-a23a-aebddb70eae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.766080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b812-d765-4fc3-a23a-aebddb70eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.766492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b812-d765-4fc3-a23a-aebddb70eae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.767274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b812-d765-4fc3-a23a-aebddb70eae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:46.769613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b812-d765-4fc3-a23a-aebddb70eae1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:46.800995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d0aa-b731-4bac-b8cd-e8eda66d777c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:46.807548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:46.808228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.808514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.808789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.809513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:46.824129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:46.900365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 846/1701] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:46 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:46.906111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.906410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.906690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.928545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 856/1702] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:46 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:46.932360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:46.948461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a423-6913-4b65-b8b2-9d29aa15332e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:46.958527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:46.959437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:46.959850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:46.961049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:46.961937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:46.964207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:46.969503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] MFA Rules not processed for user `1416ea3d97ef4396ab8975a4d43bbdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:46.970896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:47.034615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 857/1703] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:47.037373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.074780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565dc2f-4b07-4a76-8163-4d53e97ea045 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:47.082076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:47.082913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:47.083295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:47.083713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:47.084492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:47.086539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:47.102833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 858/1704] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:47.104022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.116623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0233e4-4460-4eaa-9342-50256fb5a5ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:47.126464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:47.127173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:47.128610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:47.128961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:47.129898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:47.132541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:47.155013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 847/1705] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:47.155470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 859/1706] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:47.155470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.157561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.159038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:47.172554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:47.220245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1982861-67db-4ab4-8275-69683f874cfa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:47.235051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:47.239041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:47.239462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:47.239846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] PATH_INFO: `/v3/users/3dd437f4be4c4c6788bd1968a302537b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:47.243045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd437f4be4c4c6788bd1968a302537b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:47.246923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:47.324697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213feb9-8417-4021-8cf3-fa3e2dc9d30e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:47.336391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:47.337301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:47.337634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:47.340566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:47.340566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:47.380998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:47.382678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:47.413019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 848/1707] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:47.414069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.443296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bc559-d3f1-44ad-aaa2-c66d8ec803dc service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:47.471146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:47.472055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:47.472334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:47.472607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] PATH_INFO: `/v3/projects/3d001376db88423580b63b304d87ed46/users/05c874f18e184d7c96aa20d9e9ba36da/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:47.522108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d001376db88423580b63b304d87ed46, user_id=05c874f18e184d7c96aa20d9e9ba36da, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:47.526619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:47.594962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd437f4be4c4c6788bd1968a302537b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:47.595842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd437f4be4c4c6788bd1968a302537b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:47.629984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd437f4be4c4c6788bd1968a302537b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:47.658365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:47.683688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 849/1708] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:47 2022] PUT /identity/v3/projects/3d001376db88423580b63b304d87ed46/users/05c874f18e184d7c96aa20d9e9ba36da/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:47.685135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd437f4be4c4c6788bd1968a302537b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:47.687216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.698295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:47.791620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd437f4be4c4c6788bd1968a302537b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:47.803773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 860/1709] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:47 2022] DELETE /identity/v3/users/3dd437f4be4c4c6788bd1968a302537b => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:47.807969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:47.811244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:47.945209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40920ce9-295c-4cca-b2e5-22223929e9b7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:48.000162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33a2bf-6c4e-4d03-9ba6-7f38b4bb60c4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:48.016221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:48.018130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.020668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.021060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.025867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:48.101106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:48.102005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.102406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.102785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] PATH_INFO: `/v3/projects/a3dd2ef091204912824251eab6675c31/users/6aede81940c943799dd376c3cf4a4c24/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.137297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3dd2ef091204912824251eab6675c31, user_id=6aede81940c943799dd376c3cf4a4c24, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:48.145194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:48.163821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:48.165645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:48.185655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 861/1710] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:48.186749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:48.188123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:48.223072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823621a-873b-4eeb-9f43-f3944173dae9 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:48.230658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75216d-185c-4852-bc0e-9945fbe3268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:48.231932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75216d-185c-4852-bc0e-9945fbe3268d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.232574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75216d-185c-4852-bc0e-9945fbe3268d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.233104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75216d-185c-4852-bc0e-9945fbe3268d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.235139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75216d-185c-4852-bc0e-9945fbe3268d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:48.238058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75216d-185c-4852-bc0e-9945fbe3268d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:48.265169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 862/1711] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:48.267528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.267991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.268427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.325066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 850/1712] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:47 2022] PUT /identity/v3/projects/a3dd2ef091204912824251eab6675c31/users/6aede81940c943799dd376c3cf4a4c24/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:48.325718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:48.331842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:48.357321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:48.358662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:48.563212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7983624-f3ca-419a-89af-e663e76182e5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:48.567612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 863/1713] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:48.567612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:48.582754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfe864-f77d-4ed6-8a19-6c1abaf824e7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:48.590580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c559a2-e06f-4f2b-90a9-1a6189a57171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:48.591749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c559a2-e06f-4f2b-90a9-1a6189a57171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.592161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c559a2-e06f-4f2b-90a9-1a6189a57171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.594773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c559a2-e06f-4f2b-90a9-1a6189a57171 admin admin] PATH_INFO: `/v3/projects/3d001376db88423580b63b304d87ed46/users/05c874f18e184d7c96aa20d9e9ba36da/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.605089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c559a2-e06f-4f2b-90a9-1a6189a57171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d001376db88423580b63b304d87ed46, user_id=05c874f18e184d7c96aa20d9e9ba36da, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:48.607959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c559a2-e06f-4f2b-90a9-1a6189a57171 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:48.617754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:48.623899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.624646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.626931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] PATH_INFO: `/v3/users/b47c2bc1383a40b1b0670cfe429e6842` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.627528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 864/1714] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:48 2022] PUT /identity/v3/projects/3d001376db88423580b63b304d87ed46/users/05c874f18e184d7c96aa20d9e9ba36da/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:48.629335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:48.629982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:48.630599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:48.637456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47c2bc1383a40b1b0670cfe429e6842)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:48.642588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:48.764850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] MFA Rules not processed for user `6aede81940c943799dd376c3cf4a4c24`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:48.766561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:48.946222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 865/1715] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:48.947548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:48.953169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:49.086408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:49.093248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cdc09-a8fd-421a-80eb-6f83cc75bccc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:49.105140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439f514-498c-44e5-a875-19680fca23e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:49.106690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f514-498c-44e5-a875-19680fca23e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:49.107097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f514-498c-44e5-a875-19680fca23e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:49.107807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f514-498c-44e5-a875-19680fca23e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:49.286274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f514-498c-44e5-a875-19680fca23e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:49.288137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f514-498c-44e5-a875-19680fca23e5 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:49.301345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 866/1716] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:49.303179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492b00-8770-4f0f-865d-a16c11a7162c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:49.303704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492b00-8770-4f0f-865d-a16c11a7162c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:49.304168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492b00-8770-4f0f-865d-a16c11a7162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:49.336642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47c2bc1383a40b1b0670cfe429e6842'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:49.342022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47c2bc1383a40b1b0670cfe429e6842'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:49.345179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-58492b00-8770-4f0f-865d-a16c11a7162c None None] MFA Rules not processed for user `05c874f18e184d7c96aa20d9e9ba36da`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:49.347070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-58492b00-8770-4f0f-865d-a16c11a7162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:49.401340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47c2bc1383a40b1b0670cfe429e6842'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:49.479878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47c2bc1383a40b1b0670cfe429e6842'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:49.480624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47c2bc1383a40b1b0670cfe429e6842'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:49.515189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 851/1717] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:48 2022] DELETE /identity/v3/users/b47c2bc1383a40b1b0670cfe429e6842 => generated 0 bytes in 1189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:49.516482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:49.520382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:49.537109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 867/1718] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:49.542067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:49.542564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:49.546669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:49.628810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:49.643454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:49.809604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366f93-65ee-4477-9b20-6ead88fa7748 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:49.836988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:49.840787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:49.843718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:49.843718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:49.843718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:49.851097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:49.870094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 868/1719] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:49.871293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:49.874487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:49.961042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4ea5d-af49-4787-9722-1af66fa810dc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:49.965725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:49.966796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:49.967185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:49.967564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:50.064723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 852/1720] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:49 2022] POST /identity/v3/projects => generated 383 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:50.068689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:50.073569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:50.102430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:50.106142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:50.148399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 869/1721] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:50.158875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:50.194618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d8741-d4eb-4855-be87-bf91b2041ad2 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:50.330559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6be787-7d1d-4af7-b4b5-3e51040b1fcd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:50.338296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681aee-e02b-4fdf-b35a-d85933b4a249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:50.340039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681aee-e02b-4fdf-b35a-d85933b4a249 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:50.340473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681aee-e02b-4fdf-b35a-d85933b4a249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:50.340894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681aee-e02b-4fdf-b35a-d85933b4a249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:50.475525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:50.498233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45562-82d5-42ce-ab1a-d4962bf62429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:50.502078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45562-82d5-42ce-ab1a-d4962bf62429 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:50.502078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45562-82d5-42ce-ab1a-d4962bf62429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:50.513023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45562-82d5-42ce-ab1a-d4962bf62429 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:50.517227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45562-82d5-42ce-ab1a-d4962bf62429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:50.532546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45562-82d5-42ce-ab1a-d4962bf62429 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:50.555167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13681aee-e02b-4fdf-b35a-d85933b4a249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:50.558943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13681aee-e02b-4fdf-b35a-d85933b4a249 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:50.588566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 853/1722] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:50.593633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:50.593633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:50.593633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:50.634709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] MFA Rules not processed for user `df1f64397b6e4dbeb1f39d1a27b3da3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:50.636679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:50.660648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 870/1723] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:50 2022] POST /identity/v3/users => generated 298 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:50.662611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:50.662611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:50.664915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:50.717534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] MFA Rules not processed for user `1416ea3d97ef4396ab8975a4d43bbdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:50.720161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:50.854330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 854/1724] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:50.855422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:50.921330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81fb57-a637-4019-b1cd-3cacb3cfb0f3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:50.955052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 871/1725] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:50.960223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:50.960653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:50.960936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:50.961221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:50.962010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:50.966029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:51.005915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 855/1726] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:51.010420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:51.028553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd958d48-d305-463d-bac6-7f8ba8f78905 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:51.048501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:51.056964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:51.056964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:51.056964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] PATH_INFO: `/v3/projects/db92b02093514235a5d500ea8bc5adeb/users/a33ad085b160488d8c80159062e0518d/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:51.084110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db92b02093514235a5d500ea8bc5adeb, user_id=a33ad085b160488d8c80159062e0518d, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:51.103029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:51.215032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:51.217054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:51.239095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3ce9-4823-4854-a3dd-2ca4df890915 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:51.244620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 872/1727] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:51 2022] PUT /identity/v3/projects/db92b02093514235a5d500ea8bc5adeb/users/a33ad085b160488d8c80159062e0518d/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:08:51.249503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:51.478480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435bc6a-c36d-4828-894a-b2f322b85806 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:51.485361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:51.486372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:51.486813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:51.488582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:51.489007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:51.489667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:51.496699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:51.496699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] PATH_INFO: `/v3/projects/1f87609975f14c369e08266a96672500` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:51.496875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:51.496875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:51.497019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f87609975f14c369e08266a96672500)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:51.497019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:51.562255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 873/1728] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:08:51.564354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:51.582539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bb4fb-9d35-4e6e-ab2f-2ea5200f7e94 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:51.588067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208b6c-5eb0-4670-bcb6-6342802d51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:51.588820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208b6c-5eb0-4670-bcb6-6342802d51ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:51.589201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208b6c-5eb0-4670-bcb6-6342802d51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:51.589548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208b6c-5eb0-4670-bcb6-6342802d51ec admin admin] PATH_INFO: `/v3/projects/db92b02093514235a5d500ea8bc5adeb/users/a33ad085b160488d8c80159062e0518d/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:51.592114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d208b6c-5eb0-4670-bcb6-6342802d51ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=db92b02093514235a5d500ea8bc5adeb, user_id=a33ad085b160488d8c80159062e0518d, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:51.596462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d208b6c-5eb0-4670-bcb6-6342802d51ec admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:51.628628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 874/1729] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:51 2022] PUT /identity/v3/projects/db92b02093514235a5d500ea8bc5adeb/users/a33ad085b160488d8c80159062e0518d/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:51.635648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:51.635648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:51.635648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:51.702796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:51.751039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] MFA Rules not processed for user `a33ad085b160488d8c80159062e0518d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:51.758246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:51.808880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f87609975f14c369e08266a96672500', 'request_id': 'req-72f06a9b-5eee-4cd5-8391-02374e8320ac'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:51.834702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f87609975f14c369e08266a96672500', 'request_id': 'req-72f06a9b-5eee-4cd5-8391-02374e8320ac'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.019305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 875/1730] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:52.020528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f87609975f14c369e08266a96672500', 'request_id': 'req-72f06a9b-5eee-4cd5-8391-02374e8320ac'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.027041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:52.045405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] The token cache is being invalidate because project 1f87609975f14c369e08266a96672500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:52.045708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.060112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-72f06a9b-5eee-4cd5-8391-02374e8320ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.068551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 856/1731] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:51 2022] DELETE /identity/v3/projects/1f87609975f14c369e08266a96672500 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:08:52.079567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f2a7-02f3-48ed-a439-1b02245c7e3e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:52.079862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f2a7-02f3-48ed-a439-1b02245c7e3e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:52.080147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f2a7-02f3-48ed-a439-1b02245c7e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:52.167843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-3846f2a7-02f3-48ed-a439-1b02245c7e3e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:52.169127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3846f2a7-02f3-48ed-a439-1b02245c7e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:52.261726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097b2d-f29e-46d2-958d-c06d7cc26b40 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:52.271371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:52.275275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:52.277469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:52.277469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:52.284293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:52.302523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:52.304863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:52.339025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 876/1732] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:52.340254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:52.353579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:52.405037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b587c3-9e17-4711-9e0a-7f5668f4d9e6 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:52.411335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 857/1733] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:52.411335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4133-2c13-483f-95d6-ac0e19cdbfed None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:52.411335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4133-2c13-483f-95d6-ac0e19cdbfed None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:52.412351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:52.413179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:52.413627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:52.414096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] PATH_INFO: `/v3/projects/a92339522c834cb59c3daa2424891d31` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:52.414370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4133-2c13-483f-95d6-ac0e19cdbfed None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:52.415862 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92339522c834cb59c3daa2424891d31)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:52.418005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 858/1734] 10.222.0.47 () {54 vars in 912 bytes} [Mon Oct 10 12:08:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:08:52.419712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:52.421247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4133-2c13-483f-95d6-ac0e19cdbfed None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:52.432739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-579f4133-2c13-483f-95d6-ac0e19cdbfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:52.479776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4133-2c13-483f-95d6-ac0e19cdbfed None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:52.491873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:52.492567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:52.492788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:52.493225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] PATH_INFO: `/v3/users/1b08977199e94a3d836b4737b3c381f4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:52.494640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b08977199e94a3d836b4737b3c381f4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:52.496791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:52.681728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92339522c834cb59c3daa2424891d31', 'request_id': 'req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.709202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92339522c834cb59c3daa2424891d31', 'request_id': 'req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.731851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:52.799917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92339522c834cb59c3daa2424891d31', 'request_id': 'req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.823456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] The token cache is being invalidate because project a92339522c834cb59c3daa2424891d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:52.823754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.827419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-487af1c4-3680-4b8f-a9c0-ef0b13fd08c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.829384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 877/1735] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:52 2022] DELETE /identity/v3/projects/a92339522c834cb59c3daa2424891d31 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:52.831485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162d9d-add5-45b6-8d15-4257d7dd2a0c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:52.831778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162d9d-add5-45b6-8d15-4257d7dd2a0c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:52.832061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47162d9d-add5-45b6-8d15-4257d7dd2a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:52.888748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-47162d9d-add5-45b6-8d15-4257d7dd2a0c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:52.890137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-47162d9d-add5-45b6-8d15-4257d7dd2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:52.906849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b08977199e94a3d836b4737b3c381f4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:52.908729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b08977199e94a3d836b4737b3c381f4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.013071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b08977199e94a3d836b4737b3c381f4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.069415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 878/1736] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:53.069415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:53.069415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:53.069415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:53.115784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] MFA Rules not processed for user `aa49e174aaa14829a0281441a834ef4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:53.117259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:53.222139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 879/1737] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:53.223125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:53.224496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:53.247117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ad242-c35d-4e61-8c0c-1f2bbdbf6e4c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:53.251427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b08977199e94a3d836b4737b3c381f4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.252415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b08977199e94a3d836b4737b3c381f4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.263345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:53.263345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:53.263345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:53.263345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] PATH_INFO: `/v3/users/6aede81940c943799dd376c3cf4a4c24` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:53.263924 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aede81940c943799dd376c3cf4a4c24)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:53.263924 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:53.276932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 859/1738] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:52 2022] DELETE /identity/v3/users/1b08977199e94a3d836b4737b3c381f4 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:53.278398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:53.280351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:53.480737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795a4c-14f0-44e3-9d49-a93f7e0cd1db admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:53.491023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:53.492580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:53.493444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:53.493444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] PATH_INFO: `/v3/users/251bd9f7a7584b2781d4df4ecd8e3a3c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:53.494841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251bd9f7a7584b2781d4df4ecd8e3a3c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:53.497696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:53.683957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aede81940c943799dd376c3cf4a4c24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.684702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aede81940c943799dd376c3cf4a4c24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.708014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aede81940c943799dd376c3cf4a4c24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.773651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aede81940c943799dd376c3cf4a4c24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.793186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251bd9f7a7584b2781d4df4ecd8e3a3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.803714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251bd9f7a7584b2781d4df4ecd8e3a3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.844250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251bd9f7a7584b2781d4df4ecd8e3a3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.898130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aede81940c943799dd376c3cf4a4c24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:53.908450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 880/1739] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:53 2022] DELETE /identity/v3/users/6aede81940c943799dd376c3cf4a4c24 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:53.908962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:53.911078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.003299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251bd9f7a7584b2781d4df4ecd8e3a3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:54.005349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251bd9f7a7584b2781d4df4ecd8e3a3c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:54.010346 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147464b2-526e-41fb-9553-aecc14836408 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:54.022648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:54.025319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.025319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.025319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.025319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:54.025319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:54.027611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634a91-aae9-40dc-a94e-7e78b646b79e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:54.034953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 860/1740] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:53 2022] DELETE /identity/v3/users/251bd9f7a7584b2781d4df4ecd8e3a3c => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:54.036656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:54.038618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.072273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 881/1741] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:54.072273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.072273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.074030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.102593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:54.104824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.177795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304467a-9266-4e37-8db8-5d8d1be849c4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:54.189934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:54.191253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:54.192144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.192488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.192825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.198767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.215594 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:54.217628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1febd-e4da-4012-9a73-1c4723f0b97a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:54.229168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 861/1742] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:54.239482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.239857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.240210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.289289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:54.289289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.337597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 882/1743] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:54.339087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:54.344044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.393763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263378a-3c77-4a58-873e-e554efa4b6c6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:54.436529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9800197-ee52-471c-8750-cff52aef58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:54.437711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9800197-ee52-471c-8750-cff52aef58c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.437711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9800197-ee52-471c-8750-cff52aef58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.437711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9800197-ee52-471c-8750-cff52aef58c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.438811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9800197-ee52-471c-8750-cff52aef58c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:54.452388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9800197-ee52-471c-8750-cff52aef58c6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:54.452477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 862/1744] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:54.452477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:54.454803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.499319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b7a8-3530-4edc-b4e3-1d969ec3832a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:54.510691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:54.512969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.512969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.512969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.526263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:54.527867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:54.547414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 863/1745] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:54.547414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:54.555224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac059243-2c93-4d38-8838-6f2a98d40121 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:54.559320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:54.559939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.560218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.560490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.578133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:54.582008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:54.608879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 864/1746] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:54.633339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 883/1747] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:54 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:54.637210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:54.682493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38456c28-0a47-4a3f-9048-ef6c693a9f34 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:54.695530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.695530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.695530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.841479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:54.843384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:54.859602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:54.867704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:54.867704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:54.867704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:54.868591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:54.888465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:54.893286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:55.016751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 884/1748] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:08:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:08:55.079085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 865/1749] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:54 2022] POST /identity/v3/users => generated 288 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:55.098436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:55.156797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13c4c8-6e0e-49ff-8b1a-8eebbe2fd82c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:55.180034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173814c0-da73-4527-94d8-795440032136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:55.185149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173814c0-da73-4527-94d8-795440032136 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:55.185659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173814c0-da73-4527-94d8-795440032136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:55.186180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173814c0-da73-4527-94d8-795440032136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:55.187399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173814c0-da73-4527-94d8-795440032136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:55.190708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173814c0-da73-4527-94d8-795440032136 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:55.213449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 885/1750] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:55.217835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:55.235509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980a18f-5078-4128-874e-8fc6bd263599 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:55.249185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:55.254665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:55.254665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:55.254665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:55.254665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:55.255051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:55.267351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 866/1751] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:08:55.272783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173814c0-da73-4527-94d8-795440032136 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:55.287028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173814c0-da73-4527-94d8-795440032136 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:55.298685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:55.301595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:55.309085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5d01d-2000-4d45-a3a5-988499435486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:55.314390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5d01d-2000-4d45-a3a5-988499435486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:55.314911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5d01d-2000-4d45-a3a5-988499435486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:55.315398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5d01d-2000-4d45-a3a5-988499435486 admin admin] PATH_INFO: `/v3/projects/f0e39729c67d40949939d02fce9d06e4/users/e3b24eb3d29d47e5be7a0a948fb6e86b/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:55.336545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4339c-9c1b-4349-abd2-782835a50616 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:55.349539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:55.350582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:55.351109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:55.352257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] PATH_INFO: `/v3/projects/074863dbe652447389470e71cc1b5d01` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:55.356512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=074863dbe652447389470e71cc1b5d01)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:55.360958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:55.365671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5d01d-2000-4d45-a3a5-988499435486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e39729c67d40949939d02fce9d06e4, user_id=e3b24eb3d29d47e5be7a0a948fb6e86b, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:55.371280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5d01d-2000-4d45-a3a5-988499435486 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:55.536992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 886/1752] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:55 2022] PUT /identity/v3/projects/f0e39729c67d40949939d02fce9d06e4/users/e3b24eb3d29d47e5be7a0a948fb6e86b/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:55.540228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:55.541120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:55.542688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:55.585810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074863dbe652447389470e71cc1b5d01', 'request_id': 'req-9cdcedef-41aa-45c7-aff5-c16250090cbd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:55.598762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074863dbe652447389470e71cc1b5d01', 'request_id': 'req-9cdcedef-41aa-45c7-aff5-c16250090cbd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:55.622905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] MFA Rules not processed for user `e3b24eb3d29d47e5be7a0a948fb6e86b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:55.624246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:55.710773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:55.712648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074863dbe652447389470e71cc1b5d01', 'request_id': 'req-9cdcedef-41aa-45c7-aff5-c16250090cbd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:55.731312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 887/1753] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:55.731312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:55.731312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:55.760102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] The token cache is being invalidate because project 074863dbe652447389470e71cc1b5d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:55.768220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:55.768220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:55.772682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 867/1754] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:55 2022] DELETE /identity/v3/projects/074863dbe652447389470e71cc1b5d01 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:55.779468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:55.784187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:55.996506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb725-fac5-4430-b21f-caf20d895565 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:56.002178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:56.003648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.003942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.004227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.007307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:56.163661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcedef-41aa-45c7-aff5-c16250090cbd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:56.181261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:56.187646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.187646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.187646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.211863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:56.266568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:56.269226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300931f1-36c5-41e4-9858-9ef22ba4c3f8 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:56.272457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:56.289688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:56.291934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 868/1755] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:56.298989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9a1de-8590-4e91-aeae-957695118212 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.300050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9a1de-8590-4e91-aeae-957695118212 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.307123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9a1de-8590-4e91-aeae-957695118212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.329004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 888/1756] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:08:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:08:56.333662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:56.341686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:56.388073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-44a9a1de-8590-4e91-aeae-957695118212 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:56.391708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-44a9a1de-8590-4e91-aeae-957695118212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:56.614330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:56.646994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185ec2-5481-48df-8097-e7f6dceb02a6 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:56.660935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:56.662753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.663196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.663376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] PATH_INFO: `/v3/projects/a3dd2ef091204912824251eab6675c31` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.668480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3dd2ef091204912824251eab6675c31)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:56.673915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:56.713728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 869/1757] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:56.715184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.715472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.715754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.782076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:56.783413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:56.815104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 870/1758] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:56.823673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:56.863102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e74ca-57e5-4210-acd7-9cbef1fd6434 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:56.890675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:56.891785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.892075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.892345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.893011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:56.900382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:56.909712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701a804-4168-48ec-b231-2363ad0fa449 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:56.918015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3dd2ef091204912824251eab6675c31', 'request_id': 'req-22bca413-4034-4338-a38e-9999075575d2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:56.938418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 871/1759] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:56.941033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:56.941502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:56.942061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:56.948118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3dd2ef091204912824251eab6675c31', 'request_id': 'req-22bca413-4034-4338-a38e-9999075575d2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.022558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] MFA Rules not processed for user `aa49e174aaa14829a0281441a834ef4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:57.034328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:57.052422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3dd2ef091204912824251eab6675c31', 'request_id': 'req-22bca413-4034-4338-a38e-9999075575d2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.177181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] The token cache is being invalidate because project a3dd2ef091204912824251eab6675c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:57.177898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.185136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.194649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 889/1760] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:56 2022] DELETE /identity/v3/projects/a3dd2ef091204912824251eab6675c31 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:57.196791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:57.201413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:57.237770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 872/1761] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Oct 10 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:57.239006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:57.241415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:57.369958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36719e7-7edc-43c0-a204-3c56e7b2ffbd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:57.376611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:57.378661 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:57.379098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:57.379560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] PATH_INFO: `/v3/users/a33ad085b160488d8c80159062e0518d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:57.381471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33ad085b160488d8c80159062e0518d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:57.383869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:57.470113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca413-4034-4338-a38e-9999075575d2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:57.502081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:57.503663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:57.504281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:57.504754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:57.505758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:57.508092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:57.523156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:57.652031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 890/1762] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:57 2022] POST /identity/v3/projects => generated 363 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:57.653008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:57.656518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:57.705706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33ad085b160488d8c80159062e0518d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.707862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33ad085b160488d8c80159062e0518d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.795778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33ad085b160488d8c80159062e0518d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.867226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53b00-6c95-4b19-83a9-cf278c6309f6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:57.889077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:57.889760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:57.890094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:57.890405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] PATH_INFO: `/v3/projects/6eac6ea41f2a4f2cae06b0e633f94cc2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:57.891772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eac6ea41f2a4f2cae06b0e633f94cc2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:57.901986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:57.952392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33ad085b160488d8c80159062e0518d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.953396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33ad085b160488d8c80159062e0518d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:57.974850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 873/1763] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:57 2022] DELETE /identity/v3/users/a33ad085b160488d8c80159062e0518d => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:57.976884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:57.978773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:58.157437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4e728-4d72-404c-9b20-80ccb167f30a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:58.190794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:58.193288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:58.197327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:58.198136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:58.199449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:58.206289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:58.242775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eac6ea41f2a4f2cae06b0e633f94cc2', 'request_id': 'req-fe65ba27-184f-45d5-97f8-1c08253784c0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:58.250652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eac6ea41f2a4f2cae06b0e633f94cc2', 'request_id': 'req-fe65ba27-184f-45d5-97f8-1c08253784c0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:58.451640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eac6ea41f2a4f2cae06b0e633f94cc2', 'request_id': 'req-fe65ba27-184f-45d5-97f8-1c08253784c0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:58.463615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 874/1764] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:57 2022] POST /identity/v3/users => generated 282 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:58.464690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:58.471867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:58.512525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] The token cache is being invalidate because project 6eac6ea41f2a4f2cae06b0e633f94cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:58.524098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:58.524098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:58.524098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 891/1765] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:57 2022] DELETE /identity/v3/projects/6eac6ea41f2a4f2cae06b0e633f94cc2 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:58.524098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:58.529049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:58.670880 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a1653-8e03-498f-8a64-99ba4aeb3f44 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:58.672264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65ba27-184f-45d5-97f8-1c08253784c0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:58.681621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:58.682839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:58.683340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:58.683814 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] PATH_INFO: `/v3/users/e3b24eb3d29d47e5be7a0a948fb6e86b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:58.685395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b24eb3d29d47e5be7a0a948fb6e86b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:58.693693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:58.827972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:58.829257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:58.829615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:58.830743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:58.833678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:58.848171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:58.851467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:58.865255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 875/1766] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:58.866553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:58.869945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:58.890473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bc148-c707-4c24-b7e8-4a4b86ac3aab service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:58.905760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:58.905760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:58.905760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:58.905760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:58.906200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:58.915559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:58.965944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 876/1767] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:58.974142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:58.974142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:59.007706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0cb4b-ed6a-498b-8f27-d52e6c1aa8d2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:59.020284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:59.020946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:59.021229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:59.021506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] PATH_INFO: `/v3/users/05c874f18e184d7c96aa20d9e9ba36da` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:59.026743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c874f18e184d7c96aa20d9e9ba36da)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:59.028768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:59.102889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b24eb3d29d47e5be7a0a948fb6e86b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.103708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b24eb3d29d47e5be7a0a948fb6e86b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.120729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b24eb3d29d47e5be7a0a948fb6e86b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.152022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b24eb3d29d47e5be7a0a948fb6e86b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.332669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b24eb3d29d47e5be7a0a948fb6e86b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.357215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 892/1768] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:58 2022] DELETE /identity/v3/users/e3b24eb3d29d47e5be7a0a948fb6e86b => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:59.363347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:59.371776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:59.513681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c874f18e184d7c96aa20d9e9ba36da'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.517776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c874f18e184d7c96aa20d9e9ba36da'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.566799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c874f18e184d7c96aa20d9e9ba36da'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.615165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a6de8-87b3-400a-83dc-91ec15f6ebab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:59.661049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8910efd-a444-4829-bc08-8353c7a8c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:59.665656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910efd-a444-4829-bc08-8353c7a8c34c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:59.666012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910efd-a444-4829-bc08-8353c7a8c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:59.670915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8910efd-a444-4829-bc08-8353c7a8c34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:59.677952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8910efd-a444-4829-bc08-8353c7a8c34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:59.685988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8910efd-a444-4829-bc08-8353c7a8c34c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:59.707334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c874f18e184d7c96aa20d9e9ba36da'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.709123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c874f18e184d7c96aa20d9e9ba36da'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:59.736054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 893/1769] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:59.739356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:59.739653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:59.740145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:59.788219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:59.795183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 877/1770] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:58 2022] DELETE /identity/v3/users/05c874f18e184d7c96aa20d9e9ba36da => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:59.796388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:59.798289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:59.825555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:59.943271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:00.004670 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5ffc-ef51-4e26-bb77-6f896c1f78c1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:00.031195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 894/1771] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:00.031195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:00.032690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.034205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:00.035031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.035185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.035739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] PATH_INFO: `/v3/projects/82a2335fbd5d4fbfa258d6d4ea46954a/users/bea244eb86b94f878fd60d2bd78c657a/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.050556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a71dd-a0f2-4b93-9770-f323493f4f1f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:00.057237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:00.073216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.075409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.075832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] PATH_INFO: `/v3/projects/db92b02093514235a5d500ea8bc5adeb` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.077708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=db92b02093514235a5d500ea8bc5adeb)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:00.098966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:00.117897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a2335fbd5d4fbfa258d6d4ea46954a, user_id=bea244eb86b94f878fd60d2bd78c657a, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:00.121454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:00.229822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 878/1772] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:59 2022] PUT /identity/v3/projects/82a2335fbd5d4fbfa258d6d4ea46954a/users/bea244eb86b94f878fd60d2bd78c657a/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:00.229822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:00.229822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.407956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db92b02093514235a5d500ea8bc5adeb', 'request_id': 'req-7998dde6-9c47-497c-ac5a-34587db707bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:00.424642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271100fc-d775-4400-baa1-5e85e1dbfabc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:00.428571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db92b02093514235a5d500ea8bc5adeb', 'request_id': 'req-7998dde6-9c47-497c-ac5a-34587db707bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:00.520959 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db92b02093514235a5d500ea8bc5adeb', 'request_id': 'req-7998dde6-9c47-497c-ac5a-34587db707bb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:00.566468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] The token cache is being invalidate because project db92b02093514235a5d500ea8bc5adeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:00.566468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:00.566468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7998dde6-9c47-497c-ac5a-34587db707bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:00.566468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 895/1773] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:00 2022] DELETE /identity/v3/projects/db92b02093514235a5d500ea8bc5adeb => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:00.566839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:00.573159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.573605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.574224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.575156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.576122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.576940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.578919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.643850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] MFA Rules not processed for user `bea244eb86b94f878fd60d2bd78c657a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:00.646619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.723974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:00.726823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0b051-23df-47ba-964f-560725c18a9c service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:00.760842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 879/1774] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:00.763832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87911a4-f2a4-479f-9a22-229c5c1b609b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.764212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87911a4-f2a4-479f-9a22-229c5c1b609b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.764500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87911a4-f2a4-479f-9a22-229c5c1b609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.792369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c87911a4-f2a4-479f-9a22-229c5c1b609b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:00.795778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c87911a4-f2a4-479f-9a22-229c5c1b609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.808669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 896/1775] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:00.813454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:00.816723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.817297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:00.822820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 880/1776] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:00.842208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.842744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.843103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.843702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd24a8-357c-48d7-a2e2-acda72e20f77 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:00.856951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:00.858917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.859898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.860964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.865289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:00.870521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:00.883108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:00.886677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:00.899425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 881/1777] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:00.903347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:00.924951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef0062-9c86-4818-92c1-f7503744afe5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:00.935317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:00.935317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:00.935317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:00.935317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:00.935772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:00.935772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:00.936853 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:00.960712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 882/1778] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:00.972335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:00.990389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfa709-408b-4b46-befd-ce1678d9bbb4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.006936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.054114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 897/1779] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:00 2022] POST /identity/v3/projects => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:01.054512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.054512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.054512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.054512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.054512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.060376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.201201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 883/1780] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:00 2022] POST /identity/v3/projects => generated 399 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:01.207886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.287901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e6dd-3e26-46f7-aa4f-a3236b179e3d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.457839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf6bd-d01f-4019-8ca0-fa1f56756b96 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.476689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.477526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.477987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.479815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.480159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.486176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.493072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.499284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.499284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.499284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.499284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.499284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.627263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:01.629583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 884/1781] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:01 2022] POST /identity/v3/users => generated 300 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:01.638788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 898/1782] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:01 2022] POST /identity/v3/users => generated 288 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:01.640216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.659955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.678572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbf347-b381-4d12-981c-e66022c0b827 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.689559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91b12d-4a63-4d3c-88ca-f8cb3d54696a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.692158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.695599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.696347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.696627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.696907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.697647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.698014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.699312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.700133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.700899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.703553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.709641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.721197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 899/1783] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:01.726249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.741929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 885/1784] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:01.744585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c73cb3-7c21-4ce0-8c10-3e4faf71d0d2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.747985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.758049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.758698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.763234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.763234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.763234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.763234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.782878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745f47-98c2-4319-83ff-bb1865065688 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.806204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.808521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.809538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.811097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] PATH_INFO: `/v3/projects/ffc3012734ef4fa0b0ae20727b3f97c4/users/c8d96b32456a447091a4ec777073f11f/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.814062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 900/1785] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:01.815574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:01.836365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:01.858361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc3012734ef4fa0b0ae20727b3f97c4, user_id=c8d96b32456a447091a4ec777073f11f, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.872448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:01.894209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de13e8-38c7-4f19-bcac-70692e44a23a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:01.919718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:01.926299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:01.926770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:01.927118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] PATH_INFO: `/v3/projects/3d001376db88423580b63b304d87ed46` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:01.929289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d001376db88423580b63b304d87ed46)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:01.933250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:02.068729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 886/1786] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:01 2022] PUT /identity/v3/projects/ffc3012734ef4fa0b0ae20727b3f97c4/users/c8d96b32456a447091a4ec777073f11f/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:02.068729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:02.132244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d001376db88423580b63b304d87ed46', 'request_id': 'req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:02.159467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d001376db88423580b63b304d87ed46', 'request_id': 'req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:02.251438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d001376db88423580b63b304d87ed46', 'request_id': 'req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:02.280365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] The token cache is being invalidate because project 3d001376db88423580b63b304d87ed46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:02.281017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:02.282429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cf3322a3-6593-40cf-9ba4-dcbddaf7fb20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:02.286974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 901/1787] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:01 2022] DELETE /identity/v3/projects/3d001376db88423580b63b304d87ed46 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:02.291655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9288a-8897-40be-9c78-bc44efb1b887 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.291655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9288a-8897-40be-9c78-bc44efb1b887 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.291655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9288a-8897-40be-9c78-bc44efb1b887 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.296025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 902/1788] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:09:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:09:02.297327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9288a-8897-40be-9c78-bc44efb1b887 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:02.300751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1ad9288a-8897-40be-9c78-bc44efb1b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:02.304562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397d18-85ff-4755-a7f2-c010054eb7ce admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:02.328124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:02.357811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:02.472091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9288a-8897-40be-9c78-bc44efb1b887 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:02.484171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201e4a0-f7cf-4ecc-887c-8a3451663ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:02.487438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e4a0-f7cf-4ecc-887c-8a3451663ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.487438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e4a0-f7cf-4ecc-887c-8a3451663ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.487438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201e4a0-f7cf-4ecc-887c-8a3451663ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.487438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201e4a0-f7cf-4ecc-887c-8a3451663ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:02.491436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201e4a0-f7cf-4ecc-887c-8a3451663ee0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:02.515646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 903/1789] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:02.517090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d971446-0d78-4e9d-925e-c359f193d080 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.519614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d971446-0d78-4e9d-925e-c359f193d080 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.520013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d971446-0d78-4e9d-925e-c359f193d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.524612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:02.525291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.525629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.525955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] PATH_INFO: `/v3/projects/9e163e9d0ef24a868e5c20405d627a81/users/ce8098fb55e84c4f92414bb226c10981/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.552813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e163e9d0ef24a868e5c20405d627a81, user_id=ce8098fb55e84c4f92414bb226c10981, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:02.555925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:02.563093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5d971446-0d78-4e9d-925e-c359f193d080 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:02.564578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5d971446-0d78-4e9d-925e-c359f193d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:02.576978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 904/1790] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:02.578426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f7aa-8fc1-4416-8d0f-cdf321e3267c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.578651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f7aa-8fc1-4416-8d0f-cdf321e3267c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.578926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f7aa-8fc1-4416-8d0f-cdf321e3267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.607939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5682f7aa-8fc1-4416-8d0f-cdf321e3267c None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:02.610011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5682f7aa-8fc1-4416-8d0f-cdf321e3267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:02.642624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 887/1791] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:02 2022] PUT /identity/v3/projects/9e163e9d0ef24a868e5c20405d627a81/users/ce8098fb55e84c4f92414bb226c10981/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:02.644239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:02.808874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d02ab-550f-4d94-aa15-c2c5f9d5ba79 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:02.821623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b0877-0b31-462b-8bb6-d74a7bcc741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:02.823314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b0877-0b31-462b-8bb6-d74a7bcc741c admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.823314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b0877-0b31-462b-8bb6-d74a7bcc741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.823314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b0877-0b31-462b-8bb6-d74a7bcc741c admin admin] PATH_INFO: `/v3/projects/ffc3012734ef4fa0b0ae20727b3f97c4/users/c8d96b32456a447091a4ec777073f11f/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.833840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b0877-0b31-462b-8bb6-d74a7bcc741c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc3012734ef4fa0b0ae20727b3f97c4, user_id=c8d96b32456a447091a4ec777073f11f, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:02.833840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b0877-0b31-462b-8bb6-d74a7bcc741c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:02.871284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 905/1793] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:02.871284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b810-d1f8-44b9-b36d-1c57a2a0bf8a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.873433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b810-d1f8-44b9-b36d-1c57a2a0bf8a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.874059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76b810-d1f8-44b9-b36d-1c57a2a0bf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.876134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 888/1793] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:02 2022] PUT /identity/v3/projects/ffc3012734ef4fa0b0ae20727b3f97c4/users/c8d96b32456a447091a4ec777073f11f/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:02.878216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:02.878745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:02.882315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:02.953044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7e76b810-d1f8-44b9-b36d-1c57a2a0bf8a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:02.956058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e76b810-d1f8-44b9-b36d-1c57a2a0bf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:03.005338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] MFA Rules not processed for user `ce8098fb55e84c4f92414bb226c10981`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:03.021841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:03.099723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:03.245191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 906/1794] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:03.248354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:03.248354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:03.248354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:03.314505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] MFA Rules not processed for user `c8d96b32456a447091a4ec777073f11f`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:03.317328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:03.341399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 889/1795] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:03.345777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:03.418834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df4a6-5192-4237-a7e2-ffed6cb6c72a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:03.434588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:03.437841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:03.438711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:03.439316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:03.442938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:03.443789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:03.447580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:03.483214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 890/1796] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:03.483214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:03.487721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:03.520603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece95052-b67d-4673-94d6-0c67159a48c5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:03.534312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:03.535226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:03.535672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:03.536096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:03.537029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:03.540685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:03.561578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 907/1797] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:03.561578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:03.562727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:03.614805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199fa7-7caa-4e9a-bfb8-291d834ed588 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:03.633276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:03.636610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:03.637919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:03.638580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] PATH_INFO: `/v3/projects/f0e39729c67d40949939d02fce9d06e4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:03.641365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e39729c67d40949939d02fce9d06e4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:03.647395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:03.714422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 891/1798] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:03 2022] POST /identity/v3/projects => generated 399 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:03.715361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:03.720633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:03.869742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e39729c67d40949939d02fce9d06e4', 'request_id': 'req-52e740d7-55ca-461c-a93c-2f28bc2a4834'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:03.875056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2b95-31ff-4896-8496-5567cd683079 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:03.891557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e39729c67d40949939d02fce9d06e4', 'request_id': 'req-52e740d7-55ca-461c-a93c-2f28bc2a4834'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:03.973441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:03.974434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:03.975143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:03.975593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:03.976425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:03.978692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:04.809666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e39729c67d40949939d02fce9d06e4', 'request_id': 'req-52e740d7-55ca-461c-a93c-2f28bc2a4834'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:04.812526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 892/1799] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:03 2022] POST /identity/v3/projects => generated 375 bytes in 1068 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:04.812526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:04.812526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:04.813077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] The token cache is being invalidate because project f0e39729c67d40949939d02fce9d06e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:04.813077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:04.813077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:04.813077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 908/1800] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:03 2022] DELETE /identity/v3/projects/f0e39729c67d40949939d02fce9d06e4 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:04.813077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:04.833457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:04.953815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e740d7-55ca-461c-a93c-2f28bc2a4834 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:04.974822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460747-1c73-4b4e-ba28-b304cd7860dc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:04.984490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:04.986840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:04.986840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:04.986840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:04.993461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.221127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:05.226538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:05.256833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 893/1801] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:05.260596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:05.266612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.278531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b2a08-704c-4319-8e94-f71170787864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:05.282750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b2a08-704c-4319-8e94-f71170787864 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.282750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b2a08-704c-4319-8e94-f71170787864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.282750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b2a08-704c-4319-8e94-f71170787864 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.282750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b2a08-704c-4319-8e94-f71170787864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:05.288145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b2a08-704c-4319-8e94-f71170787864 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:05.370513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:05.436424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 909/1802] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:04 2022] POST /identity/v3/users => generated 306 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:05.438084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.438399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.438689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.503771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee35f82-6bde-444e-956b-545abba5a432 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:05.514910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:05.518356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.521989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:05.523592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.524513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.525354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.532747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.540625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 910/1803] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:05.543914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:05.548217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.559990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d6540-aadf-40f8-9148-2e36abc1ebc3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:05.578920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:05.579636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.579930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.580253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.582466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:05.584427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:05.597627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:05.601751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd2c76-ad1c-479a-ae81-a97f3622df7c service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:05.635275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 894/1804] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:05.637791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259ad9-3901-478c-93c6-346c41bedcdf None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.649784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259ad9-3901-478c-93c6-346c41bedcdf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.650482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259ad9-3901-478c-93c6-346c41bedcdf None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.669347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 895/1805] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:09:05 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:09:05.671253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d259ad9-3901-478c-93c6-346c41bedcdf None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:05.705166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d259ad9-3901-478c-93c6-346c41bedcdf None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:05.726597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ae870-924b-4662-8840-db7ef1e2f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:05.727887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae870-924b-4662-8840-db7ef1e2f4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.728202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae870-924b-4662-8840-db7ef1e2f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.728632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ae870-924b-4662-8840-db7ef1e2f4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.729289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ae870-924b-4662-8840-db7ef1e2f4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:05.731502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ae870-924b-4662-8840-db7ef1e2f4ec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:05.765719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 896/1806] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:05.766598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513900f-e098-423e-8103-7c1b9a842416 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.767734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513900f-e098-423e-8103-7c1b9a842416 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.769908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513900f-e098-423e-8103-7c1b9a842416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.770342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 911/1807] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:05 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:05.773472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:05.779406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.829288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37dace-025c-43c5-8062-a37fe03f46af admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:05.845377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e513900f-e098-423e-8103-7c1b9a842416 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:05.850736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:05.850996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e513900f-e098-423e-8103-7c1b9a842416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.851079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.851193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.851729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.856548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.872073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 897/1808] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:05.873656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:05.873974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:05.874249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:05.922805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:05.925895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:05.956628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 898/1809] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:05.958317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:05.998029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ffd4a-b4af-42a5-a7f4-afc96bbf534f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.009809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.024470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.024470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.024470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] PATH_INFO: `/v3/projects/f785b7901d53450b8eb67d939709b2cf/users/e0e41417a0514e308b370624dd65f008/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.060101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f785b7901d53450b8eb67d939709b2cf, user_id=e0e41417a0514e308b370624dd65f008, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.068487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.069168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.071268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.083288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 912/1810] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:06.084350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.120265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9eeb-8bb1-4920-9834-ca36ca99e6c3 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.137498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.141125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.141125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.141125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.143011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.147734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.185677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 899/1811] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:05 2022] PUT /identity/v3/projects/f785b7901d53450b8eb67d939709b2cf/users/e0e41417a0514e308b370624dd65f008/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:06.186871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.195260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 913/1812] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:06.196104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.250866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d57a4-4ccd-482a-90ca-1ab67bdc1120 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.387798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db64d-4060-443f-84f0-a9d64b4f5353 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.410478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.413427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.413988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.415549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.416336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.416694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.416954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.418283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.423513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.423513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:06.423513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.427978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.431703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.470411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 914/1813] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:06.472121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.477665 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 900/1814] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:06.479267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.488303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:06.518523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22bfc7-3c97-4ca1-a494-3e684c230e71 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.531620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.532248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.532530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.532797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.533446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.541175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.572768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 915/1815] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:06.573835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.602723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be894b22-b14c-4d4c-90ad-dde26405c1ba admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.611045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.613054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.613574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.613826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] PATH_INFO: `/v3/projects/f785b7901d53450b8eb67d939709b2cf/users/e0e41417a0514e308b370624dd65f008/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.617481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f785b7901d53450b8eb67d939709b2cf, user_id=e0e41417a0514e308b370624dd65f008, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.625069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.652057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 916/1816] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:06 2022] PUT /identity/v3/projects/f785b7901d53450b8eb67d939709b2cf/users/e0e41417a0514e308b370624dd65f008/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:06.653544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:06.713684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb98cd3-e364-4b46-b2e4-bcd5f42dd076 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.809112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2c1a2-9a84-44f7-80f7-a51428a23564 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:06.817454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.819072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.819356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.819709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:06.820410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:06.823066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:06.990407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11883b6f-3589-42b3-b585-075216410350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:06.992549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11883b6f-3589-42b3-b585-075216410350 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:06.992549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11883b6f-3589-42b3-b585-075216410350 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:06.992549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11883b6f-3589-42b3-b585-075216410350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:07.005733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11883b6f-3589-42b3-b585-075216410350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:07.007499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11883b6f-3589-42b3-b585-075216410350 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:07.012804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 917/1817] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:06 2022] POST /identity/v3/projects => generated 363 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:07.016035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:07.036911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 901/1818] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:07.042397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:07.045062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:07.045404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:07.118806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] MFA Rules not processed for user `e0e41417a0514e308b370624dd65f008`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:07.124494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:07.264865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330109-fc6a-48e0-9823-5b568ec9299b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:07.278371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:07.280197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:07.281649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:07.282845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] PATH_INFO: `/v3/projects/4f20be7646e44af19893136cf9475e2e/users/1096b47e75e14951b3e2994a4060ab51/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:07.305402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 902/1819] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:07.310572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:07.329387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f20be7646e44af19893136cf9475e2e, user_id=1096b47e75e14951b3e2994a4060ab51, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:07.333594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:07.346130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3609-2483-45e8-a840-83f86808ba4c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:07.358942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f146a-a744-4389-8532-9c89e6816522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:07.360240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f146a-a744-4389-8532-9c89e6816522 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:07.360532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f146a-a744-4389-8532-9c89e6816522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:07.360805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f146a-a744-4389-8532-9c89e6816522 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:07.362632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f146a-a744-4389-8532-9c89e6816522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:07.368275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f146a-a744-4389-8532-9c89e6816522 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:07.479708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 918/1820] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:07 2022] PUT /identity/v3/projects/4f20be7646e44af19893136cf9475e2e/users/1096b47e75e14951b3e2994a4060ab51/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:07.489294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:07.495830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:07.582448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 903/1821] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:07 2022] POST /identity/v3/users => generated 282 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:07.585571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:07.588139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:07.588513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:07.687044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106d168-00d2-4f73-b6d9-b0f78923c8ad admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:07.692488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:07.696645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:07.696645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:07.697022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:07.697320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:07.728589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] MFA Rules not processed for user `1096b47e75e14951b3e2994a4060ab51`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:07.737234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:07.924032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:07.926703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:07.948323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 919/1822] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:07.949364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:08.019807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 904/1823] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:08.024236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:08.250752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92671c36-cbf4-4f5a-8ccd-e50cfeb589e4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:08.260830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:08.265790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:08.265790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:08.265790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:08.265790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:08.266194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:08.271703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:08.429750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11679aa-24ec-4622-ba68-7b832d33de6b service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:08.438886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:08.440461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:08.440935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:08.441414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:08.442973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:08.446407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:08.473378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 905/1824] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:08 2022] POST /identity/v3/projects => generated 377 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:08.477831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:08.489824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 920/1825] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:08.498526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:08.598363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9479f-d762-4921-bfa4-9e80d95dbe2a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:08.685967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd5a5d-d953-43cb-82c3-84575f05792e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:08.713441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:08.714223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:08.714704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:08.714988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:08.715700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:08.723720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:08.778376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:08.779036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:08.779317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:08.793982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:08.796328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:08.800689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:08.833003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 921/1826] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:08.834922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:08.873295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 906/1827] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:08 2022] POST /identity/v3/users => generated 295 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:08.877173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:08.907158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71fcc6-be16-451e-93bc-6228c013944d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:08.918489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:08.919620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:08.919958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:08.920293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] PATH_INFO: `/v3/projects/ba3588cf4abb4ee28192d0cbdc89608f/users/02056e91cc1c47a9a32dc67eac02257a/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:08.940330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3588cf4abb4ee28192d0cbdc89608f, user_id=02056e91cc1c47a9a32dc67eac02257a, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:08.943556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:08.966388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68557fd-1d0d-4b37-9dd1-b305964c2286 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:08.972320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:08.973160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:08.973554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:08.973958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:08.978381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:09.012103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 907/1828] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:08 2022] PUT /identity/v3/projects/ba3588cf4abb4ee28192d0cbdc89608f/users/02056e91cc1c47a9a32dc67eac02257a/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:09.014009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:09.161046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:09.162651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a12af1-9f73-4a11-808f-52dc93c9c7f6 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:09.176321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 922/1829] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:09.177880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:09.178228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:09.178503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:09.284799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93e5a9-22c9-427d-932e-1eaaffb20d83 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:09.300112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] MFA Rules not processed for user `02056e91cc1c47a9a32dc67eac02257a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:09.304322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:09.306316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:09.306996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:09.307283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:09.307554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:09.317182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:09.317182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:09.348768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 908/1830] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:09.353611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:09.380629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d0139-1e0d-4f42-93db-22ea55eaab69 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:09.391583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:09.392264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:09.392543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:09.392878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] PATH_INFO: `/v3/projects/03a9e56825dd459684b75ce25b4d31b4/users/d63049ed7b2b4d0e9ed96dca8da2dc3d/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:09.438014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9e56825dd459684b75ce25b4d31b4, user_id=d63049ed7b2b4d0e9ed96dca8da2dc3d, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:09.438184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:09.632773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 909/1831] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:09 2022] PUT /identity/v3/projects/03a9e56825dd459684b75ce25b4d31b4/users/d63049ed7b2b4d0e9ed96dca8da2dc3d/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:09.640017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:09.701964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 923/1832] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:09.703972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:09.756547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3e3ff-6633-4e2b-b79a-112684d3d576 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:09.962167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:09.963362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:09.964603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:09.965316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:09.967198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:09.978049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.024797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188deb4-f674-4123-b4f1-b8e6db933b16 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.051653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.055235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.058987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.059698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.060790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.068257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.100773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 910/1833] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:10.107610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:10.135373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d4940-b929-490a-9ce8-ee8ff587f7ad admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.142443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6035-e6c8-4116-9028-e532dfa391a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.144142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6035-e6c8-4116-9028-e532dfa391a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.144652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6035-e6c8-4116-9028-e532dfa391a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.146509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6035-e6c8-4116-9028-e532dfa391a0 admin admin] PATH_INFO: `/v3/projects/03a9e56825dd459684b75ce25b4d31b4/users/d63049ed7b2b4d0e9ed96dca8da2dc3d/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.150158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6035-e6c8-4116-9028-e532dfa391a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9e56825dd459684b75ce25b4d31b4, user_id=d63049ed7b2b4d0e9ed96dca8da2dc3d, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.154306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6035-e6c8-4116-9028-e532dfa391a0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.167893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 911/1834] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:10 2022] PUT /identity/v3/projects/03a9e56825dd459684b75ce25b4d31b4/users/d63049ed7b2b4d0e9ed96dca8da2dc3d/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:10.179391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.179793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.179955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.199049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 924/1835] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:09 2022] POST /identity/v3/projects => generated 363 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:10.199931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:10.249647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] MFA Rules not processed for user `d63049ed7b2b4d0e9ed96dca8da2dc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:10.254881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:10.318487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fb74b-b0f0-4bcf-95f9-ac01a36ca1e6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.340832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.343643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.344240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.344695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.345436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.350412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.434447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 912/1836] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:10.457019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:10.497434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 925/1837] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:10 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:10.498796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:10.538952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add08056-bcfd-4369-a32c-68f808af8030 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.545373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.562226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.562520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.562796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.567035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.573972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.576888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49ec94-51d2-4f41-9bc9-bf04597533bd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.588835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.589600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.594811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.595730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.621920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 926/1838] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:10.625813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:10.649585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ede09-ea08-4cab-b893-5b27ba801c1e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.654940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.655992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.656451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.657026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] PATH_INFO: `/v3/projects/dd4db636e34c4c43983c568f6bd2757d/users/d39ec76b6ac7494084033ddba86a4312/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.682331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4db636e34c4c43983c568f6bd2757d, user_id=d39ec76b6ac7494084033ddba86a4312, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.686956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.712046 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.713555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.724434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 913/1839] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:09:10.804362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:10.810991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 927/1840] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:10 2022] PUT /identity/v3/projects/dd4db636e34c4c43983c568f6bd2757d/users/d39ec76b6ac7494084033ddba86a4312/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:10.815246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:10.834144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ac034-2800-4bc8-be41-3def98b9286b service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:10.954362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cac781-0bae-4794-97ff-05bd83d5f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:10.957592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac781-0bae-4794-97ff-05bd83d5f18d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:10.958260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac781-0bae-4794-97ff-05bd83d5f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:10.958550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac781-0bae-4794-97ff-05bd83d5f18d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:10.960032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cac781-0bae-4794-97ff-05bd83d5f18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:10.963288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cac781-0bae-4794-97ff-05bd83d5f18d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:10.995443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 914/1841] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:11.001390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:11.026734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f7505-c8c7-45a5-857b-e405bc77d99a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:11.046525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:11.047210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:11.047499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:11.047767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] PATH_INFO: `/v3/projects/dd4db636e34c4c43983c568f6bd2757d/users/d39ec76b6ac7494084033ddba86a4312/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:11.050363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4db636e34c4c43983c568f6bd2757d, user_id=d39ec76b6ac7494084033ddba86a4312, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:11.053315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:11.076210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:11.076402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:11.076662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:11.079714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 928/1842] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:10 2022] PUT /identity/v3/projects/dd4db636e34c4c43983c568f6bd2757d/users/d39ec76b6ac7494084033ddba86a4312/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:11.110164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] MFA Rules not processed for user `d39ec76b6ac7494084033ddba86a4312`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:11.112679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:11.265814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 915/1843] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:11.289184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:11.356600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:11.365578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7076eb-2886-47b9-a478-e34dcfc0f945 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:11.369331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:11.370097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:11.370376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:11.370647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:11.382185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:11.383833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:11.393928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 929/1844] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:11.921791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:11.934425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9857c-b896-41be-b551-8dc0215890a8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:11.938020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:11.938617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:11.938892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:11.939163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:12.014791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:12.014791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:12.024809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 916/1845] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:13.635360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:14.144073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:14.201416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:14.210352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ca315-b26a-41cf-bd79-ef46cb7a0971 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:14.214069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:14.214759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:14.216297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:14.216297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:14.278397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:14.279834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:14.290196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 930/1846] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:14.363832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:16.216397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:16.271229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:16.337993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:16.342458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f12e-7b59-4ef6-a989-f5f9e9daecfe service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:16.347860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:16.348502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:16.348785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:16.349062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] PATH_INFO: `/v3/users/02056e91cc1c47a9a32dc67eac02257a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:16.350482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02056e91cc1c47a9a32dc67eac02257a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:16.352560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:16.555624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02056e91cc1c47a9a32dc67eac02257a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.556385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02056e91cc1c47a9a32dc67eac02257a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.571160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02056e91cc1c47a9a32dc67eac02257a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.668994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:16.682869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eab81f-033d-48b8-b8d9-a312c1789c05 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:16.691477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:16.692122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:16.692403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:16.692682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] PATH_INFO: `/v3/users/ce8098fb55e84c4f92414bb226c10981` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:16.693950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8098fb55e84c4f92414bb226c10981)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:16.696045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:16.714030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02056e91cc1c47a9a32dc67eac02257a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.714696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-be02b6ed-c7be-4f81-a47d-2d5fd60576a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02056e91cc1c47a9a32dc67eac02257a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.730231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 917/1847] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:16 2022] DELETE /identity/v3/users/02056e91cc1c47a9a32dc67eac02257a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:16.734739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:16.735033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:16.735315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:16.755463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:16.756761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:16.837065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 918/1848] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:16.850360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:16.852043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:16.906619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8098fb55e84c4f92414bb226c10981'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.907334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8098fb55e84c4f92414bb226c10981'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.916554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8098fb55e84c4f92414bb226c10981'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.929687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d1295-9438-43e4-b45a-bd1ecc3c1e95 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:16.933986 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:16.934222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8098fb55e84c4f92414bb226c10981'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:16.934636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:16.934914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:16.935199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:16.937380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:16.952338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:16.954478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ecc61-c424-4626-b01c-fed5f393eca7 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:16.967232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 919/1849] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:17.011545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8098fb55e84c4f92414bb226c10981'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:17.021964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 931/1850] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:16 2022] DELETE /identity/v3/users/ce8098fb55e84c4f92414bb226c10981 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:17.028338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:17.028620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:17.028892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:17.050599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:17.052138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:17.129806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 920/1851] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:17.142297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:17.142817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:17.218106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4016a3c-ca5e-41af-85e1-cdda58968672 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:17.228453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:17.229167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:17.229559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:17.229971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:17.251417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:17.253628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:17.265133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 932/1852] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:17.547690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:17.561886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:17.582896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b8c7-8b55-4b81-a1ea-97c054bc1b7b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:17.589656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:17.590927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:17.592427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:17.592826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] PATH_INFO: `/v3/projects/ba3588cf4abb4ee28192d0cbdc89608f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:17.594603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3588cf4abb4ee28192d0cbdc89608f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:17.598540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:17.743430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3588cf4abb4ee28192d0cbdc89608f', 'request_id': 'req-6c6334a6-2830-43d9-a977-245713abc19b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:17.751679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3588cf4abb4ee28192d0cbdc89608f', 'request_id': 'req-6c6334a6-2830-43d9-a977-245713abc19b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:17.886091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3588cf4abb4ee28192d0cbdc89608f', 'request_id': 'req-6c6334a6-2830-43d9-a977-245713abc19b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:17.923243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] The token cache is being invalidate because project ba3588cf4abb4ee28192d0cbdc89608f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:17.924154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:17.925663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:17.935806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:17.936668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 921/1853] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:17 2022] DELETE /identity/v3/projects/ba3588cf4abb4ee28192d0cbdc89608f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:17.948301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143496f-e7cb-420d-84a8-f797e12902db service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:18.078321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:18.078879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:18.079179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:18.079456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] PATH_INFO: `/v3/users/d39ec76b6ac7494084033ddba86a4312` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:18.081304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39ec76b6ac7494084033ddba86a4312)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:18.083333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:18.128197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:18.131738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:18.152854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6334a6-2830-43d9-a977-245713abc19b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:18.160928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:18.162087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:18.162595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:18.163115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] PATH_INFO: `/v3/projects/9e163e9d0ef24a868e5c20405d627a81` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:18.165230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e163e9d0ef24a868e5c20405d627a81)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:18.168217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:18.324415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39ec76b6ac7494084033ddba86a4312'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.325083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39ec76b6ac7494084033ddba86a4312'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.333324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39ec76b6ac7494084033ddba86a4312'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.351295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39ec76b6ac7494084033ddba86a4312'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.362397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e163e9d0ef24a868e5c20405d627a81', 'request_id': 'req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.368865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e163e9d0ef24a868e5c20405d627a81', 'request_id': 'req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.445427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39ec76b6ac7494084033ddba86a4312'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.471395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 933/1854] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:17 2022] DELETE /identity/v3/users/d39ec76b6ac7494084033ddba86a4312 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:18.548049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e163e9d0ef24a868e5c20405d627a81', 'request_id': 'req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.596837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] The token cache is being invalidate because project 9e163e9d0ef24a868e5c20405d627a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:18.596837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.596837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:18.596837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 922/1855] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:18 2022] DELETE /identity/v3/projects/9e163e9d0ef24a868e5c20405d627a81 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:18.599588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:18.602538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:18.679935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:18.725247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8635c-20cc-4cda-b21c-a84085fc1e64 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:18.730236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:18.730925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:18.731428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:18.731710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] PATH_INFO: `/v3/users/e0e41417a0514e308b370624dd65f008` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:18.732889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e41417a0514e308b370624dd65f008)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:18.735958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:18.931218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:19.020095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e41417a0514e308b370624dd65f008'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.020842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e41417a0514e308b370624dd65f008'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.028791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e41417a0514e308b370624dd65f008'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.042336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:19.043714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:19.068416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e41417a0514e308b370624dd65f008'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.173570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e41417a0514e308b370624dd65f008'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.190419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 934/1856] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:18 2022] DELETE /identity/v3/users/e0e41417a0514e308b370624dd65f008 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:19.192210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:19.194862 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:19.201947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59dbb2-96f6-44b9-a6d3-fe18dccced03 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:19.339953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4a49-5b4d-465b-9cf4-ed45359cb86b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:19.347008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:19.348480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:19.348844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:19.350174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] PATH_INFO: `/v3/users/bea244eb86b94f878fd60d2bd78c657a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:19.351987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea244eb86b94f878fd60d2bd78c657a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:19.354594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:19.366208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:19.368433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:19.368882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:19.369171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] PATH_INFO: `/v3/projects/dd4db636e34c4c43983c568f6bd2757d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:19.371030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4db636e34c4c43983c568f6bd2757d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:19.373514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:19.710784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4db636e34c4c43983c568f6bd2757d', 'request_id': 'req-d6ac794c-e20b-41be-949e-f99f520a241b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.714737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea244eb86b94f878fd60d2bd78c657a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.715528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea244eb86b94f878fd60d2bd78c657a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.717976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4db636e34c4c43983c568f6bd2757d', 'request_id': 'req-d6ac794c-e20b-41be-949e-f99f520a241b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.723363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea244eb86b94f878fd60d2bd78c657a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.747828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea244eb86b94f878fd60d2bd78c657a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.844750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4db636e34c4c43983c568f6bd2757d', 'request_id': 'req-d6ac794c-e20b-41be-949e-f99f520a241b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.858006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] The token cache is being invalidate because project dd4db636e34c4c43983c568f6bd2757d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:19.858675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.858967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.860735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 923/1857] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:19 2022] DELETE /identity/v3/projects/dd4db636e34c4c43983c568f6bd2757d => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:19.861873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:19.864203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:19.940623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac794c-e20b-41be-949e-f99f520a241b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:19.946391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:19.947261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:19.947697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:19.948128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] PATH_INFO: `/v3/projects/f785b7901d53450b8eb67d939709b2cf` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:19.949465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f785b7901d53450b8eb67d939709b2cf)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:19.952279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49b885b0-3bcc-42de-aa06-eee0ef5d89ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea244eb86b94f878fd60d2bd78c657a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:19.955393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:19.979381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 935/1858] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:19 2022] DELETE /identity/v3/users/bea244eb86b94f878fd60d2bd78c657a => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:19.981707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8000-551a-4b35-bd73-c6ba11c051d6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:19.983535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8000-551a-4b35-bd73-c6ba11c051d6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:19.984131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8000-551a-4b35-bd73-c6ba11c051d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.021356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3afe8000-551a-4b35-bd73-c6ba11c051d6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.023777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3afe8000-551a-4b35-bd73-c6ba11c051d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.110403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 936/1859] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:20.112270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461003-6be2-487f-9b09-a6975f25c731 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.112759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461003-6be2-487f-9b09-a6975f25c731 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.113103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44461003-6be2-487f-9b09-a6975f25c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.133973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f785b7901d53450b8eb67d939709b2cf', 'request_id': 'req-325f0225-d905-483c-8621-468ba2a44d5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.138599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-44461003-6be2-487f-9b09-a6975f25c731 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.140620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-44461003-6be2-487f-9b09-a6975f25c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.141947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f785b7901d53450b8eb67d939709b2cf', 'request_id': 'req-325f0225-d905-483c-8621-468ba2a44d5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.223961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 937/1860] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:20.225630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48df7-befb-4fac-8168-4eb188788c88 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.226067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48df7-befb-4fac-8168-4eb188788c88 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.226351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48df7-befb-4fac-8168-4eb188788c88 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.227786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 938/1861] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:09:20.233265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.233265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.233265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.234548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f785b7901d53450b8eb67d939709b2cf', 'request_id': 'req-325f0225-d905-483c-8621-468ba2a44d5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.248294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] The token cache is being invalidate because project f785b7901d53450b8eb67d939709b2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:20.248612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.249724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.253962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 924/1862] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:19 2022] DELETE /identity/v3/projects/f785b7901d53450b8eb67d939709b2cf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:20.254105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.254187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.254293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.254370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.261376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 939/1863] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:20.262332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.264199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.267361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f0225-d905-483c-8621-468ba2a44d5d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:20.274189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:20.274814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.275098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.275465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] PATH_INFO: `/v3/users/1096b47e75e14951b3e2994a4060ab51` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.276725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1096b47e75e14951b3e2994a4060ab51)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:20.278779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:20.326302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10058a-8303-448a-b3a4-cf7e139963a1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:20.330797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:20.331413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.331699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.331971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.333758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.345958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:20.351100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0ab4e-e734-4299-832a-7558de48dfca service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:20.357792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 940/1864] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:20.359109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655ec5-121e-4b4c-9548-22c92b09b132 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.359397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655ec5-121e-4b4c-9548-22c92b09b132 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.359670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655ec5-121e-4b4c-9548-22c92b09b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.383484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-76655ec5-121e-4b4c-9548-22c92b09b132 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.384736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-76655ec5-121e-4b4c-9548-22c92b09b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.494737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 941/1865] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:20.496056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.503458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.503458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.521176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.522425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.531424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 942/1866] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:20.532312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.542513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190ba6b-782b-4afa-8332-fd55c7fdea40 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:20.547513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:20.548134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.548412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.548747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.549533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:20.549817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:20.551480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae4e16-a109-4682-adf2-a289f8449459 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:20.556700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1096b47e75e14951b3e2994a4060ab51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.558270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1096b47e75e14951b3e2994a4060ab51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.565560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 943/1867] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:20.566922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.567215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.567501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.584629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1096b47e75e14951b3e2994a4060ab51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.593296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.595187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.608458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 944/1868] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:20.608458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.610037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.627900 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40d515-d99f-4b49-bb9d-776e9b0664ad None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:20.634767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:20.635410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.635751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.636063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.636674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:20.639052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:20.754389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1096b47e75e14951b3e2994a4060ab51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.755535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1096b47e75e14951b3e2994a4060ab51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.779798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 925/1869] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:20 2022] DELETE /identity/v3/users/1096b47e75e14951b3e2994a4060ab51 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:20.781765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.800598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 945/1870] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:20.803870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.808783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.829752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:20.933780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9841d-7a25-48a5-82ff-50d4fea1330e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.012964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40586-f61f-4afd-b142-487ca2c836f6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.029458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.031333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.032152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.032459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.038242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.056771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.059029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffe087-e08a-4268-a6d9-dbfc200297b6 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.064526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.065408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.066082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.066571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.067577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:21.068031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.069839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.073539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 946/1871] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:21.077132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.077132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.077132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.094050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 926/1872] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:21.094762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.107856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:21.112007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115d25-c1de-45c4-9e48-cc8360f687fe admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.112224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.114633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.115923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.116213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.116554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.117204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.119814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.121372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 947/1873] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:21.122046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.123950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.139756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcbdc5-f21c-42a0-bcd2-a68c6acaf83e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.144985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.145783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.146188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.147024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] PATH_INFO: `/v3/projects/82a2335fbd5d4fbfa258d6d4ea46954a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.147769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a2335fbd5d4fbfa258d6d4ea46954a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.149719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.268376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 927/1874] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:21.272845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.282650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a2335fbd5d4fbfa258d6d4ea46954a', 'request_id': 'req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.286203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d09767-2280-4309-855d-b9056a0f3892 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.292149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a2335fbd5d4fbfa258d6d4ea46954a', 'request_id': 'req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.377099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a2335fbd5d4fbfa258d6d4ea46954a', 'request_id': 'req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.385931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.390156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.390566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.390852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.391710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.394137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.397496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] The token cache is being invalidate because project 82a2335fbd5d4fbfa258d6d4ea46954a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:21.398698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.398973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.403546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 948/1875] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:21 2022] DELETE /identity/v3/projects/82a2335fbd5d4fbfa258d6d4ea46954a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:21.403546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.403546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.488869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321e457-ae17-4b39-b2a0-dd4c2fc81fd6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.492605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.493281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.493551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.493823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.498932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.508462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.509941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.520675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 949/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:21.523242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.524608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.537273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 928/1877] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/projects => generated 407 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:21.538563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.538741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cafa80-6a0c-4c1a-bbbb-ee81795f56bd service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.541627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.607430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.608215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.608596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.608930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.609648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.611769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.626081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 950/1878] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.627147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.630698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.650011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b027bc-690e-4367-a29b-f43e20697395 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.656355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.657055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.657396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.657740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.659115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.659269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb6d1b-76c6-4a20-9d7a-d631e1c17bd3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.661180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.664510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.665322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.665608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.665935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] PATH_INFO: `/v3/users/c8d96b32456a447091a4ec777073f11f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.667304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d96b32456a447091a4ec777073f11f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.669239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.816442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 951/1879] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/users => generated 304 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:21.817775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.835333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0b1d-8524-4b6b-ae98-353e05a9fb67 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.847398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.849271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.849271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.849980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.851871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.855685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.879913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 952/1880] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.885008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.901099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0735-15ff-4c75-90fe-f2e7ad6889a5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.911970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.913108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.913737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.914355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.916019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.918559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.949465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 953/1881] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.952127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d96b32456a447091a4ec777073f11f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.953043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d96b32456a447091a4ec777073f11f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:21.958178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.959585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:21.962210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.990506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67ab3-65fa-4c6d-953f-354281435fc5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.992587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d96b32456a447091a4ec777073f11f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.001729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.004120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.004595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.005344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] PATH_INFO: `/v3/projects/c636faba8e7745c28c6c13d30890dc0f/users/01fd81a757794befa57ab9724582ab34/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.034506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c636faba8e7745c28c6c13d30890dc0f, user_id=01fd81a757794befa57ab9724582ab34, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.042395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.113828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d96b32456a447091a4ec777073f11f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.114797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d96b32456a447091a4ec777073f11f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.134481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 929/1882] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:21 2022] DELETE /identity/v3/users/c8d96b32456a447091a4ec777073f11f => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:22.135426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.136897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.155925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 954/1883] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:21 2022] PUT /identity/v3/projects/c636faba8e7745c28c6c13d30890dc0f/users/01fd81a757794befa57ab9724582ab34/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:22.169923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.171746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.246652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78293-2552-422c-a47b-a3b1b4c9f94e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.293312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744618da-00ca-424e-9db2-3b51a3bb8927 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.300676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.300676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.300676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.300676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] PATH_INFO: `/v3/projects/4f20be7646e44af19893136cf9475e2e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.302378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f20be7646e44af19893136cf9475e2e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.304344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.354045 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9eb8-05ae-48d2-be91-17223da68d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.354686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9eb8-05ae-48d2-be91-17223da68d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.354969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9eb8-05ae-48d2-be91-17223da68d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.355242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9eb8-05ae-48d2-be91-17223da68d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.355900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a9eb8-05ae-48d2-be91-17223da68d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.357657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a9eb8-05ae-48d2-be91-17223da68d27 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.386965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 930/1884] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:22.386965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.386965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.386965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.415518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] MFA Rules not processed for user `01fd81a757794befa57ab9724582ab34`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:22.416756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.460428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f20be7646e44af19893136cf9475e2e', 'request_id': 'req-79640b49-6d92-4d2c-95bb-76337fd8ec28'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.471075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f20be7646e44af19893136cf9475e2e', 'request_id': 'req-79640b49-6d92-4d2c-95bb-76337fd8ec28'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.503919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 931/1885] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:22.504923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.519333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a99135-f066-40bc-a0b5-b257b6a069c4 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.538418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:22.583257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f20be7646e44af19893136cf9475e2e', 'request_id': 'req-79640b49-6d92-4d2c-95bb-76337fd8ec28'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.602816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] The token cache is being invalidate because project 4f20be7646e44af19893136cf9475e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:22.603226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.603812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:22.605058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.608316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 955/1886] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:22 2022] DELETE /identity/v3/projects/4f20be7646e44af19893136cf9475e2e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:22.608482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.608574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.608662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.608662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] PATH_INFO: `/v3/projects/326546a6b41e4e3abe3b20f531c47cf6/users/96097a316ae2496f89c9e2ecd7505b17/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.608919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.623888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79640b49-6d92-4d2c-95bb-76337fd8ec28 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.629779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.630538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.631134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.631704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.632593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.635187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.636194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=326546a6b41e4e3abe3b20f531c47cf6, user_id=96097a316ae2496f89c9e2ecd7505b17, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.639070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.799943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 932/1887] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:22 2022] PUT /identity/v3/projects/326546a6b41e4e3abe3b20f531c47cf6/users/96097a316ae2496f89c9e2ecd7505b17/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:22.800807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.801441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 956/1888] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:22 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:22.802202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.803826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.805591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.885638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11187456-56a1-455d-9f26-14346cdc3464 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.888022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.888698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.888976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.889298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] PATH_INFO: `/v3/projects/ffc3012734ef4fa0b0ae20727b3f97c4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.889917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765214a-38d0-41d4-8917-bc0f766f5c9b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.890481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc3012734ef4fa0b0ae20727b3f97c4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.892952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.895883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.896697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.897067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.897568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] PATH_INFO: `/v3/users/d63049ed7b2b4d0e9ed96dca8da2dc3d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.898960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63049ed7b2b4d0e9ed96dca8da2dc3d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.901340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:23.184062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63049ed7b2b4d0e9ed96dca8da2dc3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.185252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63049ed7b2b4d0e9ed96dca8da2dc3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.213926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc3012734ef4fa0b0ae20727b3f97c4', 'request_id': 'req-04b72360-291e-424e-84c3-83707cc0420f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.222166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63049ed7b2b4d0e9ed96dca8da2dc3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.224397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc3012734ef4fa0b0ae20727b3f97c4', 'request_id': 'req-04b72360-291e-424e-84c3-83707cc0420f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.405707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc3012734ef4fa0b0ae20727b3f97c4', 'request_id': 'req-04b72360-291e-424e-84c3-83707cc0420f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.418638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] The token cache is being invalidate because project ffc3012734ef4fa0b0ae20727b3f97c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:23.418926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.419597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.421212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 957/1889] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:22 2022] DELETE /identity/v3/projects/ffc3012734ef4fa0b0ae20727b3f97c4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:23.422178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:23.423611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:23.503026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63049ed7b2b4d0e9ed96dca8da2dc3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.504459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-747a4c77-00c3-436c-a2a4-d8f0aceb2ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63049ed7b2b4d0e9ed96dca8da2dc3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:23.512721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b72360-291e-424e-84c3-83707cc0420f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:23.520193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6acbfd-a324-4f35-a852-5a68255ab10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:23.521126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6acbfd-a324-4f35-a852-5a68255ab10f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.521462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6acbfd-a324-4f35-a852-5a68255ab10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.522033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6acbfd-a324-4f35-a852-5a68255ab10f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.522894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 933/1890] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:22 2022] DELETE /identity/v3/users/d63049ed7b2b4d0e9ed96dca8da2dc3d => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:23.525307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6acbfd-a324-4f35-a852-5a68255ab10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:23.525407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.525407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.525407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.526712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6acbfd-a324-4f35-a852-5a68255ab10f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:23.561020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] MFA Rules not processed for user `96097a316ae2496f89c9e2ecd7505b17`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:23.562766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:23.664199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 958/1891] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:23 2022] POST /identity/v3/users => generated 303 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:23.666710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.666710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.666710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.682424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 934/1892] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:23.687230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:23.699269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:23.700675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:23.781688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 959/1893] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:23.783123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:23.785004 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:23.799501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7953a-ab25-4d49-99cb-1288d47eedd2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:23.804633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a0924-8cb6-45b2-847d-d1149ee1e8d6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:23.805103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:23.806043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.806395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.806741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.807579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:23.809738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:23.813391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404467ee-bc6b-4e45-8bc5-886d34410ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:23.814024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404467ee-bc6b-4e45-8bc5-886d34410ace admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.815097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404467ee-bc6b-4e45-8bc5-886d34410ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.818555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404467ee-bc6b-4e45-8bc5-886d34410ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.819275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404467ee-bc6b-4e45-8bc5-886d34410ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:23.823782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404467ee-bc6b-4e45-8bc5-886d34410ace admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:23.850326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 935/1894] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:23.850326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.850326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.850326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.897601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:23.899701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:23.910020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 936/1895] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:23.910878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:23.923380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe7b63-93f1-43f7-b526-b31256eae2e2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:23.929250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:23.929993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:23.930278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:23.930555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] PATH_INFO: `/v3/projects/a50c8d581bc9404ca88e15652ee27503/users/cdf93fc6bd834b7b8f79dd840a33c69e/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:23.955105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50c8d581bc9404ca88e15652ee27503, user_id=cdf93fc6bd834b7b8f79dd840a33c69e, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:23.958151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:23.977884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 960/1896] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:23 2022] POST /identity/v3/projects => generated 409 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:23.979039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.062307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 937/1897] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:23 2022] PUT /identity/v3/projects/a50c8d581bc9404ca88e15652ee27503/users/cdf93fc6bd834b7b8f79dd840a33c69e/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:24.063228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.069160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de2488-850a-4f42-9fe8-ca1e529957a3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.163514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b59443-9851-438c-bf43-41027ef49e01 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.168107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.168541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.169123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.169406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.170182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:24.170297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.170492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.170921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.171214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.171493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.172129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.172647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.176096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.190060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 961/1898] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:24.192712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.209543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e259-d7e3-40eb-afb5-0334fe0609ee admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.213718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.214384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.215070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.215070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.215620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.217260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.229944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 962/1899] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:24.232458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.242352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e21c-c336-4dd2-9f62-c1deb3565ef8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.247317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.247933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.248219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.248950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.249495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.251922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.289081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 938/1900] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:24 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:24.289081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.302543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff61bf-4edc-4b90-8404-7a1e82e7dead admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.309090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.309784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.310249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.310427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] PATH_INFO: `/v3/projects/a50c8d581bc9404ca88e15652ee27503/users/cdf93fc6bd834b7b8f79dd840a33c69e/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.312537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50c8d581bc9404ca88e15652ee27503, user_id=cdf93fc6bd834b7b8f79dd840a33c69e, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.316274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.332275 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 939/1901] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:24 2022] PUT /identity/v3/projects/a50c8d581bc9404ca88e15652ee27503/users/cdf93fc6bd834b7b8f79dd840a33c69e/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:24.333007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.335039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:24.432947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0378d9-c619-4e7f-b978-ba92eaf9b992 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.436402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.436590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 963/1902] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:24 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:24.436590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.440960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.440960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.441233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] PATH_INFO: `/v3/projects/03a9e56825dd459684b75ce25b4d31b4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.442602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a9e56825dd459684b75ce25b4d31b4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.444767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.571611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bedbb3-ac81-4dab-9627-0c0faf2b6c00 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.575491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d90d80-6656-44c9-9d1f-aee9454f8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.576129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d90d80-6656-44c9-9d1f-aee9454f8162 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.576779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d90d80-6656-44c9-9d1f-aee9454f8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.577084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d90d80-6656-44c9-9d1f-aee9454f8162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.577739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d90d80-6656-44c9-9d1f-aee9454f8162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.579467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d90d80-6656-44c9-9d1f-aee9454f8162 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.592737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 964/1903] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:24.598269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.598641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.598871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.632547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] MFA Rules not processed for user `cdf93fc6bd834b7b8f79dd840a33c69e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:24.633727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:24.647515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a9e56825dd459684b75ce25b4d31b4', 'request_id': 'req-ad157c02-c7ee-474c-984b-551cd26195c4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:24.660140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a9e56825dd459684b75ce25b4d31b4', 'request_id': 'req-ad157c02-c7ee-474c-984b-551cd26195c4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:24.763634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 965/1904] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:24.774945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.800013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a9e56825dd459684b75ce25b4d31b4', 'request_id': 'req-ad157c02-c7ee-474c-984b-551cd26195c4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:24.814415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] The token cache is being invalidate because project 03a9e56825dd459684b75ce25b4d31b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:24.814741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:24.815883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:24.817429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 940/1905] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:24 2022] DELETE /identity/v3/projects/03a9e56825dd459684b75ce25b4d31b4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:24.818194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.819526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:24.837067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:24.873286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494da6b3-09e1-4eca-9ec2-62522dd663d2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.880988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.881714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.882107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.882584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.883389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.885375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.932522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad157c02-c7ee-474c-984b-551cd26195c4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:24.937758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859cd3c-4534-4d99-a9a2-1a37c4798835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:24.938702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859cd3c-4534-4d99-a9a2-1a37c4798835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:24.938994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859cd3c-4534-4d99-a9a2-1a37c4798835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:24.939314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859cd3c-4534-4d99-a9a2-1a37c4798835 admin admin] PATH_INFO: `/v3/projects/e834105cf710442e93a9a758dfc12307/users/0130e0dcc2634f02ac8553aaa1705daa/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:24.959258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859cd3c-4534-4d99-a9a2-1a37c4798835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e834105cf710442e93a9a758dfc12307, user_id=0130e0dcc2634f02ac8553aaa1705daa, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:24.962197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859cd3c-4534-4d99-a9a2-1a37c4798835 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:24.992453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 966/1906] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:24 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:24.992453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:24.993599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.085355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 941/1907] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:24 2022] PUT /identity/v3/projects/e834105cf710442e93a9a758dfc12307/users/0130e0dcc2634f02ac8553aaa1705daa/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:25.088168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.088610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.089322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.094090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a94b-6729-498f-b91a-8ad7fd9aed4f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.148532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:25.149874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.177164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.177814 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.178242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.178585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.180749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.251640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 942/1908] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:25.252697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.254085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.267111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07b185-e511-4aa8-9ca8-d31a4d81b9c5 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.273474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.274395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.274864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.275312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.276359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.278338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.290938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 943/1909] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:25.291919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.294720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.296353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac274d-24d0-434a-9f5a-0a5a7d3a0b1a service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.305222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915734ba-a771-4ed4-bca0-f9b4df68e74f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.310285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 967/1910] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:25.311688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.311984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.312245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.315644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.317581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.318525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.319364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.321416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.325282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.332647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:25.345583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:25.345583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.352254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 944/1911] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:25.353877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.358974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 968/1912] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:25.364163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.375224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312f205-ae43-4f9a-a0cf-7a58ec894634 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.379351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b8201-90f0-43f8-99c3-7ecc8619a15e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.384402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.384589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.386829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.386829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.387054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.387158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] PATH_INFO: `/v3/projects/e834105cf710442e93a9a758dfc12307/users/0130e0dcc2634f02ac8553aaa1705daa/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.387243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.387463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.388968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e834105cf710442e93a9a758dfc12307, user_id=0130e0dcc2634f02ac8553aaa1705daa, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.389235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.391866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.392888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.410948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 945/1913] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:25.410948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.411355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 969/1914] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:25 2022] PUT /identity/v3/projects/e834105cf710442e93a9a758dfc12307/users/0130e0dcc2634f02ac8553aaa1705daa/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:25.411355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.419258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.427008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97d463-df14-4beb-853d-c03cdcdaa362 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.494508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd0e1e-e134-407c-85a2-bbd99fee3de5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.495614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.496245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.496531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.496848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.497482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:25.497789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.499134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.499486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.499971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.500338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.500718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.503014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.516036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 946/1915] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:25.516036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.525451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c76b-a387-4cdd-865c-a7dd8d681d8a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.531313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.532303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.532673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.533952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] PATH_INFO: `/v3/projects/ae027ed407154fd98da1528421b62a82/users/f9ab788de20f4cd5a25c6fdb3f7209a5/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.552965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae027ed407154fd98da1528421b62a82, user_id=f9ab788de20f4cd5a25c6fdb3f7209a5, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.558464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.604916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.607836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c317b00-8663-4d73-9db2-aa2bd2413497 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:25.626490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 970/1916] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:25.629402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aeac8-48c6-488b-89e4-34275e69fcde None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.629725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aeac8-48c6-488b-89e4-34275e69fcde None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.630266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aeac8-48c6-488b-89e4-34275e69fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.672074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 947/1917] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:25 2022] PUT /identity/v3/projects/ae027ed407154fd98da1528421b62a82/users/f9ab788de20f4cd5a25c6fdb3f7209a5/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:25.685527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e47aeac8-48c6-488b-89e4-34275e69fcde None None] MFA Rules not processed for user `0130e0dcc2634f02ac8553aaa1705daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:25.686571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:25.687108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e47aeac8-48c6-488b-89e4-34275e69fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.820558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 971/1918] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:25.820558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.820558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.821456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.886709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4d032-84ef-4cf6-85b7-ac201cada777 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:25.889149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] MFA Rules not processed for user `f9ab788de20f4cd5a25c6fdb3f7209a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:25.889149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:25.895547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:25.896057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:25.896347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:25.897130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:25.897248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:25.899553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.036474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 972/1919] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:26.036474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.046458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 948/1920] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:25 2022] POST /identity/v3/projects => generated 389 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:26.047349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.140564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b514917-99d4-46f7-ab87-a0d9bd68b708 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.150776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.151494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.151897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.153493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.154409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.156459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.178236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4757e51-c93c-428e-a2d2-df8175e53229 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.273938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 949/1921] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:26 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:26.277497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.280462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.281823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.282359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.283662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.432897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1449335-6056-474c-ac03-3fd737cce6f1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.442373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.443843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.444630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.444928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.445210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.445440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.446148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.449903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.485970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 973/1922] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:26 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:26.485970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.492790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff500242-a6fd-4f46-af3d-52e34c1317be service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.500553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.501283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.501566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.501928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.502575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.509960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.662511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 974/1923] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:26 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:26.664838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 950/1924] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:26 2022] POST /identity/v3/users => generated 295 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:26.670821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.687199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e488c4c-80db-428f-8acf-8e4098de6b19 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.687692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.693157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.693787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.694097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.694437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.695101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.697189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.705957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c00bf-ca0b-4bf5-996c-e9ef21e01c1c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.713560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 975/1925] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:26.714510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.717471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.718315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.719909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.720410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.722738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.725140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.727875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd7db-e83f-489c-85ae-7aacdfbc4d50 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.733223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.733928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.734215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.734497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] PATH_INFO: `/v3/projects/1cdd65895ea74023b07f47b8c955cef7/users/273ba2801c8e47b5a7904d46c69830b8/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.742430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 951/1926] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:26.748500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.752310 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd65895ea74023b07f47b8c955cef7, user_id=273ba2801c8e47b5a7904d46c69830b8, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.755106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.763002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb005d8-5d71-491f-b160-39dfbbbcb0ac admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.773246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:26.775530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.785815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.785815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.785815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.785815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.785815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.804925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 952/1927] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:26.810256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.829642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fea31-d052-48e5-baa4-f0ca44c2585d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:26.839153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49f9c5-2e6b-4e9b-a4df-c1ac834642ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:26.840308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f9c5-2e6b-4e9b-a4df-c1ac834642ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.840606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f9c5-2e6b-4e9b-a4df-c1ac834642ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.840951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49f9c5-2e6b-4e9b-a4df-c1ac834642ef admin admin] PATH_INFO: `/v3/projects/587a3d3ceb7b4678993cb04053b67179/users/6ba2c8202b9a4ebc8d13fdb8f595534b/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.850836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 976/1928] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:26 2022] PUT /identity/v3/projects/1cdd65895ea74023b07f47b8c955cef7/users/273ba2801c8e47b5a7904d46c69830b8/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:26.859719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:26.866992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49f9c5-2e6b-4e9b-a4df-c1ac834642ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=587a3d3ceb7b4678993cb04053b67179, user_id=6ba2c8202b9a4ebc8d13fdb8f595534b, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:26.871102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49f9c5-2e6b-4e9b-a4df-c1ac834642ef admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:26.965891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 953/1929] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:26 2022] PUT /identity/v3/projects/587a3d3ceb7b4678993cb04053b67179/users/6ba2c8202b9a4ebc8d13fdb8f595534b/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:26.969521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:26.970057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:26.970340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:26.988863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c87d1-9c96-42b7-b04c-61e5b42c5424 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.024537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] MFA Rules not processed for user `6ba2c8202b9a4ebc8d13fdb8f595534b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:27.026017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:27.073073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.073901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.074239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.076303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.077070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.078823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.097948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 977/1930] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:27.100631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.122839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177f901-4886-41ed-9f8e-ffa8dbd76809 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.131232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2cd2f-12db-4c8a-bf42-4b4dc0680b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.132393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2cd2f-12db-4c8a-bf42-4b4dc0680b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.143683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2cd2f-12db-4c8a-bf42-4b4dc0680b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.143683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2cd2f-12db-4c8a-bf42-4b4dc0680b17 admin admin] PATH_INFO: `/v3/projects/1cdd65895ea74023b07f47b8c955cef7/users/273ba2801c8e47b5a7904d46c69830b8/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.154540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2cd2f-12db-4c8a-bf42-4b4dc0680b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd65895ea74023b07f47b8c955cef7, user_id=273ba2801c8e47b5a7904d46c69830b8, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.161136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2cd2f-12db-4c8a-bf42-4b4dc0680b17 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.188157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 954/1931] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:27.191980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 978/1932] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:27 2022] PUT /identity/v3/projects/1cdd65895ea74023b07f47b8c955cef7/users/273ba2801c8e47b5a7904d46c69830b8/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:27.209578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.211674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.211973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.213319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.230899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45082f09-340c-4201-b00d-4783acec50b2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.310259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] MFA Rules not processed for user `273ba2801c8e47b5a7904d46c69830b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:27.313197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:27.344705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.346292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.346912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.347574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.348460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.350814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.435728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 979/1933] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:27.437001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.504854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 955/1934] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:27 2022] POST /identity/v3/projects => generated 389 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:27.506348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.549999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84d306-5327-4dff-8290-d0e34ce7f85a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.635661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.636635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.637097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.639016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.641376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:27.642302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449342a6-073b-4ef0-bb3f-302c3172bfc8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.650431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.652074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.652074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.652074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.653977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.657494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.755241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.757615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.781419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 980/1935] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:27.782729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 956/1936] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:27 2022] POST /identity/v3/users => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:27.783777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.813048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.816660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372e267-66a9-42e6-9aaf-cca8cd32eef8 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.829288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.832571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.833083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.833556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.834739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.838190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.853478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2238c-1722-4a8c-9c52-0750f6b925df admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.858138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 981/1937] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:27.863207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:27.867523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.868163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.868444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.868719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.902520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a3fe4-f9a9-47c3-938b-746dcb832928 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:27.913244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:27.917433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:27.917840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:27.918419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] PATH_INFO: `/v3/projects/1fd4bdf66b8d40d0b95d1259a4613275/users/80061ea977bd40ae89d1969248636f01/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:27.945039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd4bdf66b8d40d0b95d1259a4613275, user_id=80061ea977bd40ae89d1969248636f01, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.948689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:27.987912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:27.989795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:28.002458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 957/1938] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:09:28.105353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 982/1939] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:27 2022] PUT /identity/v3/projects/1fd4bdf66b8d40d0b95d1259a4613275/users/80061ea977bd40ae89d1969248636f01/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:28.109939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:28.130916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51ec4a-29e7-4f9d-aafe-3e70c5f34afe service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:28.212622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af732d-039b-4aa3-b496-0f67fcada7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:28.213219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af732d-039b-4aa3-b496-0f67fcada7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:28.213500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af732d-039b-4aa3-b496-0f67fcada7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:28.213776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af732d-039b-4aa3-b496-0f67fcada7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:28.214440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af732d-039b-4aa3-b496-0f67fcada7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:28.216034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af732d-039b-4aa3-b496-0f67fcada7c3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:28.236845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 958/1940] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:28.242031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:28.258838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:28.264014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce949cd-330a-4b6f-8465-63232cbeda23 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:28.271227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:28.274546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:28.274546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:28.274546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] PATH_INFO: `/v3/projects/1fd4bdf66b8d40d0b95d1259a4613275/users/80061ea977bd40ae89d1969248636f01/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:28.276873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd4bdf66b8d40d0b95d1259a4613275, user_id=80061ea977bd40ae89d1969248636f01, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:28.280913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:28.295732 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 983/1941] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:28 2022] PUT /identity/v3/projects/1fd4bdf66b8d40d0b95d1259a4613275/users/80061ea977bd40ae89d1969248636f01/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:28.307377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:28.307639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:28.307938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:28.346200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] MFA Rules not processed for user `80061ea977bd40ae89d1969248636f01`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:28.347439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:28.421764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 959/1942] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:28.832980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:28.896517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4eba-7a4e-4fa9-920e-eb6e0f437db6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:28.902905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:28.903828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:28.904214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:28.904509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:28.915976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:28.917429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:28.928296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 984/1943] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:28.964281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:29.905949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:30.001962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092406ed-0167-4534-9884-39c9b4d716e3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:30.009677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273ba2801c8e47b5a7904d46c69830b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdd65895ea74023b07f47b8c955cef7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:30.010818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.011464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.011936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.012856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:30.013466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:30.015540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:30.057734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 960/1944] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:30.066611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:30.082312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9729-ba99-4468-b527-d714ddc10ed1 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:30.098219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273ba2801c8e47b5a7904d46c69830b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdd65895ea74023b07f47b8c955cef7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:30.098365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.098726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.099076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.100069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:30.105783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:30.115966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:30.219398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f870-e306-4be2-bc29-5cdce2af8024 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:30.226440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:30.227189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.227475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.227856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] PATH_INFO: `/v3/users/6ba2c8202b9a4ebc8d13fdb8f595534b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.239393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba2c8202b9a4ebc8d13fdb8f595534b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:30.239393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:30.290334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 985/1945] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:30 2022] POST /identity/v3/projects => generated 354 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:30.295473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:30.387592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2d4b-919c-4d33-9fa1-b6581e7ac460 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:30.394420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273ba2801c8e47b5a7904d46c69830b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdd65895ea74023b07f47b8c955cef7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:30.395357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.395867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.396333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.398679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:30.398679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:30.401388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:30.418452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 986/1946] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:30.477551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:30.488131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8fe0a-5252-4017-932a-a3963a2e9aba tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:30.493017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273ba2801c8e47b5a7904d46c69830b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cdd65895ea74023b07f47b8c955cef7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:30.493660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.494042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.494368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] PATH_INFO: `/v3/projects/2d68c0397e014513aa01eb638fcc107c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.495514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d68c0397e014513aa01eb638fcc107c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:30.497376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:30.518967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba2c8202b9a4ebc8d13fdb8f595534b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.519937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba2c8202b9a4ebc8d13fdb8f595534b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.535542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba2c8202b9a4ebc8d13fdb8f595534b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.550307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:30.641991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d68c0397e014513aa01eb638fcc107c', 'request_id': 'req-1742e0b9-76b2-448d-abbf-e0beb6a7d487'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.650107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d68c0397e014513aa01eb638fcc107c', 'request_id': 'req-1742e0b9-76b2-448d-abbf-e0beb6a7d487'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.667542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba2c8202b9a4ebc8d13fdb8f595534b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.678095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-12688b86-13e1-4ac8-85e3-590b19cbcf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba2c8202b9a4ebc8d13fdb8f595534b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.684888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 961/1947] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:30 2022] DELETE /identity/v3/users/6ba2c8202b9a4ebc8d13fdb8f595534b => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:30.690074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.690422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.690798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.720355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:30.720355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:30.779881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d68c0397e014513aa01eb638fcc107c', 'request_id': 'req-1742e0b9-76b2-448d-abbf-e0beb6a7d487'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.782550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:30.796111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] The token cache is being invalidate because project 2d68c0397e014513aa01eb638fcc107c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:30.796607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.797354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:30.799653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 987/1948] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:30 2022] DELETE /identity/v3/projects/2d68c0397e014513aa01eb638fcc107c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:30.805587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 962/1949] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:30.815677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:30.819058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:30.881554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742e0b9-76b2-448d-abbf-e0beb6a7d487 tempest-VolumeQuotaClassesTest-1773021922 tempest-VolumeQuotaClassesTest-1773021922-project-admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:30.941431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:30.942676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:30.945287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:30.945287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:30.946797 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:30.968292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:30.971680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:30.990869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 988/1950] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:31.544222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:31.545878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:31.562401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc47cc-5793-4bd5-86e0-5dfa30abdb17 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:31.565544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:31.613289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:31.616288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:31.616911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:31.617511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] PATH_INFO: `/v3/projects/587a3d3ceb7b4678993cb04053b67179` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:31.623981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587a3d3ceb7b4678993cb04053b67179)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:31.634583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:31.729375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:31.787033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587a3d3ceb7b4678993cb04053b67179', 'request_id': 'req-e1dfdc08-b270-42a9-a959-76c08d042af6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:31.799248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587a3d3ceb7b4678993cb04053b67179', 'request_id': 'req-e1dfdc08-b270-42a9-a959-76c08d042af6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:31.878860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:31.883607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:31.907229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c310d6f-e961-4034-a814-35705715765c service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:31.934553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587a3d3ceb7b4678993cb04053b67179', 'request_id': 'req-e1dfdc08-b270-42a9-a959-76c08d042af6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:31.953104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] The token cache is being invalidate because project 587a3d3ceb7b4678993cb04053b67179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:31.953440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:31.954854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:31.956838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 963/1951] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:31 2022] DELETE /identity/v3/projects/587a3d3ceb7b4678993cb04053b67179 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:31.960952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:31.962407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:32.017558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:32.018685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:32.019114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:32.019664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] PATH_INFO: `/v3/users/f9ab788de20f4cd5a25c6fdb3f7209a5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:32.021490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ab788de20f4cd5a25c6fdb3f7209a5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:32.024421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:32.066946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfdc08-b270-42a9-a959-76c08d042af6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:32.073026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:32.073763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:32.074167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:32.074518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] PATH_INFO: `/v3/users/80061ea977bd40ae89d1969248636f01` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:32.075785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80061ea977bd40ae89d1969248636f01)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:32.077890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:32.986388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ab788de20f4cd5a25c6fdb3f7209a5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:32.987255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ab788de20f4cd5a25c6fdb3f7209a5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:32.991692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80061ea977bd40ae89d1969248636f01'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:32.998875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ab788de20f4cd5a25c6fdb3f7209a5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.000168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80061ea977bd40ae89d1969248636f01'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.032236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ab788de20f4cd5a25c6fdb3f7209a5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.147345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80061ea977bd40ae89d1969248636f01'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.628958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f9f1fc9-a7e4-4cd7-ac62-61a4d933eab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ab788de20f4cd5a25c6fdb3f7209a5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.631334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:33.638746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 989/1952] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:31 2022] DELETE /identity/v3/users/f9ab788de20f4cd5a25c6fdb3f7209a5 => generated 0 bytes in 1762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:33.652731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:33.654036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:33.654499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:33.678301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:33.679605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:33.748030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80061ea977bd40ae89d1969248636f01'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.750049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80061ea977bd40ae89d1969248636f01'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:33.764822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 990/1953] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:33.774149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:33.776956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:33.780172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 964/1954] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:31 2022] DELETE /identity/v3/users/80061ea977bd40ae89d1969248636f01 => generated 0 bytes in 1819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:33.886470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:33.935656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe0bdf-8479-4fe4-bbf5-3057ad927039 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:34.062777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:34.063817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:34.063817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:34.064115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:34.217363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:34.219315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:34.228370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:34.246410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 991/1955] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:34.639863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:34.659638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:34.661140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:34.712038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11888cd4-9581-486a-aa27-5ae4bc8faa28 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:34.730648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:34.731320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:34.738344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:34.739664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] PATH_INFO: `/v3/projects/1fd4bdf66b8d40d0b95d1259a4613275` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:34.741739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd4bdf66b8d40d0b95d1259a4613275)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:34.752896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:34.934091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:34.935789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:34.951549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3375b-b40d-4165-94e8-ecf1b3b9f9e1 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:34.999555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:35.014041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.014555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.015035 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] PATH_INFO: `/v3/projects/ae027ed407154fd98da1528421b62a82` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.023608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae027ed407154fd98da1528421b62a82)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:35.028736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:35.042172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd4bdf66b8d40d0b95d1259a4613275', 'request_id': 'req-dd0abaff-cba4-47e7-9794-e3fd337205b1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.067416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd4bdf66b8d40d0b95d1259a4613275', 'request_id': 'req-dd0abaff-cba4-47e7-9794-e3fd337205b1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.155563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd4bdf66b8d40d0b95d1259a4613275', 'request_id': 'req-dd0abaff-cba4-47e7-9794-e3fd337205b1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.184007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] The token cache is being invalidate because project 1fd4bdf66b8d40d0b95d1259a4613275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:35.186083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.188766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dd0abaff-cba4-47e7-9794-e3fd337205b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.196589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 965/1956] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:34 2022] DELETE /identity/v3/projects/1fd4bdf66b8d40d0b95d1259a4613275 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:35.200647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c7914-18ce-4b40-93ab-addde357babf None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.201190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c7914-18ce-4b40-93ab-addde357babf None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.201582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c7914-18ce-4b40-93ab-addde357babf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.248283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2e7c7914-18ce-4b40-93ab-addde357babf None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:35.264257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2e7c7914-18ce-4b40-93ab-addde357babf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:35.268180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae027ed407154fd98da1528421b62a82', 'request_id': 'req-5f992d87-f739-41ac-9942-67500568c23d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.286745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae027ed407154fd98da1528421b62a82', 'request_id': 'req-5f992d87-f739-41ac-9942-67500568c23d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.361890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 966/1957] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:35.370808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.371484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.371965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.394974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae027ed407154fd98da1528421b62a82', 'request_id': 'req-5f992d87-f739-41ac-9942-67500568c23d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.414290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] The token cache is being invalidate because project ae027ed407154fd98da1528421b62a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:35.414713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.416263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:35.416891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.418693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:35.421689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 992/1958] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:34 2022] DELETE /identity/v3/projects/ae027ed407154fd98da1528421b62a82 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:35.425991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:35.431302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:35.433447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 967/1959] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:35.435553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:35.450523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f765e-4b49-4279-9277-8242ad7f3185 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:35.461093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:35.474132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.474132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.474132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.474132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:35.474132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:35.474132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:35.475875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992d87-f739-41ac-9942-67500568c23d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:35.479612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:35.480415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.480801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.481183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] PATH_INFO: `/v3/users/273ba2801c8e47b5a7904d46c69830b8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.482591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=273ba2801c8e47b5a7904d46c69830b8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:35.484718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:35.510841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 968/1960] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:35.522756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:35.561323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0a888-7660-4ff8-b951-33de13720c68 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:35.567877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:35.573029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.573029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.573029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.573029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:35.573029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:35.703715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 969/1961] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:35 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:35.704294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:35.717669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:35.752490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273ba2801c8e47b5a7904d46c69830b8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.757943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273ba2801c8e47b5a7904d46c69830b8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.772724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273ba2801c8e47b5a7904d46c69830b8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.795848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273ba2801c8e47b5a7904d46c69830b8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.892851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000da88-ca1d-4ed5-a907-1e575e732b6e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:35.901687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:35.905097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:35.905097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:35.905097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] PATH_INFO: `/v3/users/01fd81a757794befa57ab9724582ab34` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:35.905097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fd81a757794befa57ab9724582ab34)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:35.908536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:35.930963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273ba2801c8e47b5a7904d46c69830b8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:35.933523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:35.950249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 993/1962] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:35 2022] DELETE /identity/v3/users/273ba2801c8e47b5a7904d46c69830b8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:35.950249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:35.950249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:36.044209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c4084-e718-4485-b2b9-29d17fbfec9f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:36.057756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:36.058439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.058739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.059208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.060018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:36.062255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:36.259629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 994/1963] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:35 2022] POST /identity/v3/users => generated 287 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:36.263816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:36.281199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892f485-5c28-4e08-9032-a987b8beb51f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:36.302566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:36.305008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.306960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.307469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.308446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fd81a757794befa57ab9724582ab34'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.310028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:36.310619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fd81a757794befa57ab9724582ab34'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.312403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:36.333342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 995/1964] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:36.334782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:36.336795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:36.352468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fd81a757794befa57ab9724582ab34'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.358206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866145-edf6-4ba2-bd15-0b1dad7955ed admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:36.367938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:36.369208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.369793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.370136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.371148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:36.372580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:36.393008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:36.394162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 996/1965] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:36.395268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:36.410177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2fba-ebd8-4a03-8bd1-0a9250db074d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:36.419424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c455-525f-4820-a252-5c95ec02f508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:36.422208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c455-525f-4820-a252-5c95ec02f508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.422208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c455-525f-4820-a252-5c95ec02f508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.422208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c455-525f-4820-a252-5c95ec02f508 admin admin] PATH_INFO: `/v3/projects/39b30d79cc374681a69ef2801227a02d/users/879342ff5bf24debad4ce7f65800273e/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.440097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826c455-525f-4820-a252-5c95ec02f508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b30d79cc374681a69ef2801227a02d, user_id=879342ff5bf24debad4ce7f65800273e, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:36.443798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826c455-525f-4820-a252-5c95ec02f508 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:36.473526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fd81a757794befa57ab9724582ab34'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.474242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fd81a757794befa57ab9724582ab34'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.491208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 970/1966] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:35 2022] DELETE /identity/v3/users/01fd81a757794befa57ab9724582ab34 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:36.492266 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:36.493677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:36.537771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 997/1967] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:36 2022] PUT /identity/v3/projects/39b30d79cc374681a69ef2801227a02d/users/879342ff5bf24debad4ce7f65800273e/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:36.548032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8093c-d573-48db-92ee-62848c4a661f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.549067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8093c-d573-48db-92ee-62848c4a661f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.549602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8093c-d573-48db-92ee-62848c4a661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.572002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad380ec4-74c5-45fd-b985-91220a7d8942 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:36.583312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a7d8093c-d573-48db-92ee-62848c4a661f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:36.584876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a7d8093c-d573-48db-92ee-62848c4a661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:36.668420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:36.669070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.669324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 998/1968] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:36.669513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.669811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] PATH_INFO: `/v3/users/3699fc29c57d46948c756ecdeffee190` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.670646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.670932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.671103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3699fc29c57d46948c756ecdeffee190)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:36.671242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.673045 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:36.708270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] MFA Rules not processed for user `879342ff5bf24debad4ce7f65800273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:36.709527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:36.786781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 999/1969] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:36.787613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:36.788933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:36.803649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf0101-7a13-4c6b-8216-3e77c43e3867 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:36.808240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:36.808871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:36.809155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:36.809486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] PATH_INFO: `/v3/projects/1cdd65895ea74023b07f47b8c955cef7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:36.810645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdd65895ea74023b07f47b8c955cef7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:36.812567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:36.938276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3699fc29c57d46948c756ecdeffee190'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.939242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3699fc29c57d46948c756ecdeffee190'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.951748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3699fc29c57d46948c756ecdeffee190'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.982319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdd65895ea74023b07f47b8c955cef7', 'request_id': 'req-9226c222-078c-4d95-ae33-fe246ab2454c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:36.989136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdd65895ea74023b07f47b8c955cef7', 'request_id': 'req-9226c222-078c-4d95-ae33-fe246ab2454c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:37.030842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3699fc29c57d46948c756ecdeffee190'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:37.031445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3699fc29c57d46948c756ecdeffee190'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:37.049627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 971/1970] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:36 2022] DELETE /identity/v3/users/3699fc29c57d46948c756ecdeffee190 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:37.050467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.051936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.088818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdd65895ea74023b07f47b8c955cef7', 'request_id': 'req-9226c222-078c-4d95-ae33-fe246ab2454c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:37.107641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] The token cache is being invalidate because project 1cdd65895ea74023b07f47b8c955cef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:37.108092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:37.109029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:37.117251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1000/1971] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:36 2022] DELETE /identity/v3/projects/1cdd65895ea74023b07f47b8c955cef7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:37.118582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.120721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.126573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b411a7-571b-4a96-ba1b-7364b03fbb4c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.132778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.132778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.132778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.133151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.135718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.222686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c222-078c-4d95-ae33-fe246ab2454c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.252982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.254768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e0b46-5872-4217-b376-317ac439ec7a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.266403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 972/1972] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:37.268391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe88f-da92-4aaa-ba6b-e884ae3a0617 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.268676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe88f-da92-4aaa-ba6b-e884ae3a0617 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.268943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fe88f-da92-4aaa-ba6b-e884ae3a0617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.293530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1a2fe88f-da92-4aaa-ba6b-e884ae3a0617 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:37.294983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1a2fe88f-da92-4aaa-ba6b-e884ae3a0617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.309029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 973/1973] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:37.309029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.309029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.309029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.333555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:37.336291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.338858 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.339600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.340662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.340965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.342502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.346782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.364119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 974/1974] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:37.364119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.368272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.388181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b427a2-2504-45cf-b27a-d5082a0f8ae7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.400121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cab9b-aa45-489f-9f50-44989d9a0b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.402063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cab9b-aa45-489f-9f50-44989d9a0b13 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.402461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cab9b-aa45-489f-9f50-44989d9a0b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.403221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cab9b-aa45-489f-9f50-44989d9a0b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.424159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cab9b-aa45-489f-9f50-44989d9a0b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.433686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cab9b-aa45-489f-9f50-44989d9a0b13 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.459207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 975/1975] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:37.461025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.461445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.461867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.490443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:37.492398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:37.509969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 976/1976] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:37.516766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.517882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:37.527895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1001/1977] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/projects => generated 373 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:37.532029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.535569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26bb4-417b-48af-a6b8-258e0564c787 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.619487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1770c-33a5-4d99-9201-a7f1c84290a4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.626953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.629694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.629694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.629694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.634932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.638276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.661783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.666704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.666704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.666704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.666704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:37.666704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.668814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.689946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 977/1978] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:09:37.695781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.706815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11d68-501a-47db-a208-cd31d076106a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.711752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.712377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.712664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.712941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.713599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.715612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.725303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:37.780005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1002/1979] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:37.781798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.794393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9776f-3fd0-4930-89b9-39f08aed538b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.800605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.800848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.801126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.801400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.802077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.804305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.818176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1003/1980] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:37.822671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.837297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 978/1981] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:37.843305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:37.845746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725865a-7af7-4485-9699-a7e5c954cf59 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.947089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ae7c-659f-4f42-b974-738d839f4aec admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:37.952778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.953530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.953820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.954144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.955415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.957802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:37.959508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:37.960185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:37.960464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:37.960744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] PATH_INFO: `/v3/projects/e7578be6786f46a28004d4113bc1e4ad/users/fe7784d6aa834f268a1132f84c132347/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:37.979260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7578be6786f46a28004d4113bc1e4ad, user_id=fe7784d6aa834f268a1132f84c132347, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:37.982087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.059407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 979/1982] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:37 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:38.060896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:38.063628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:38.085885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71942-656b-412a-ab3c-2d427e96a4b6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:38.088967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1004/1983] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:37 2022] PUT /identity/v3/projects/e7578be6786f46a28004d4113bc1e4ad/users/fe7784d6aa834f268a1132f84c132347/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:38.090143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:38.092870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:38.172132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:38.172790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:38.173072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:38.173382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] PATH_INFO: `/v3/projects/c636faba8e7745c28c6c13d30890dc0f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:38.174634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c636faba8e7745c28c6c13d30890dc0f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:38.176683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.186405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed30daa-3dac-4fb7-bf41-338fa6e5f040 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:38.201094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:38.202681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:38.202681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:38.202888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] PATH_INFO: `/v3/projects/bd2f99641c254d22a9f01f467677254d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:38.218560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2f99641c254d22a9f01f467677254d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:38.222858 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.404568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c636faba8e7745c28c6c13d30890dc0f', 'request_id': 'req-50d1a550-e021-42a5-a1de-d899f0cb9d8f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.405805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2f99641c254d22a9f01f467677254d', 'request_id': 'req-259db7a3-0055-4a52-ba50-bd29d457d640'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.413473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2f99641c254d22a9f01f467677254d', 'request_id': 'req-259db7a3-0055-4a52-ba50-bd29d457d640'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.424178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c636faba8e7745c28c6c13d30890dc0f', 'request_id': 'req-50d1a550-e021-42a5-a1de-d899f0cb9d8f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.499457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2f99641c254d22a9f01f467677254d', 'request_id': 'req-259db7a3-0055-4a52-ba50-bd29d457d640'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.512852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] The token cache is being invalidate because project bd2f99641c254d22a9f01f467677254d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:38.513311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.514946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.520244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1005/1984] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:38 2022] DELETE /identity/v3/projects/bd2f99641c254d22a9f01f467677254d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:38.521550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:38.523150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:38.583808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c636faba8e7745c28c6c13d30890dc0f', 'request_id': 'req-50d1a550-e021-42a5-a1de-d899f0cb9d8f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.599930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] The token cache is being invalidate because project c636faba8e7745c28c6c13d30890dc0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:38.600279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.600989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.603092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 980/1985] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:38 2022] DELETE /identity/v3/projects/c636faba8e7745c28c6c13d30890dc0f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:38.604266 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:38.607174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:38.648234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db7a3-0055-4a52-ba50-bd29d457d640 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:38.660459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:38.661404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:38.661919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:38.662352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:38.663206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:38.665280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.685608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1006/1986] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:38.687233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:38.693326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:38.713326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa98cf1-828d-4c0f-a1f6-7e7824aca2e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:38.718942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:38.719791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1a550-e021-42a5-a1de-d899f0cb9d8f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:38.720206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:38.720509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:38.721239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] PATH_INFO: `/v3/users/91b4c20aea684f27a29d518feb62005c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:38.722586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b4c20aea684f27a29d518feb62005c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:38.724877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.728145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:38.728779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:38.729062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:38.729331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:38.730032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:38.731744 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.760858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 981/1987] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:38.762552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:38.765252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:38.781537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fcf96-a65b-41f0-89b7-fb5e053dea1e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:38.790701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:38.791685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:38.791974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:38.792386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] PATH_INFO: `/v3/users/96097a316ae2496f89c9e2ecd7505b17` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:38.794109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96097a316ae2496f89c9e2ecd7505b17)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:38.796549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:38.859299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:38.962791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b4c20aea684f27a29d518feb62005c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.963870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b4c20aea684f27a29d518feb62005c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.977197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b4c20aea684f27a29d518feb62005c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:38.997692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b4c20aea684f27a29d518feb62005c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.054390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96097a316ae2496f89c9e2ecd7505b17'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.055277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96097a316ae2496f89c9e2ecd7505b17'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.068229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96097a316ae2496f89c9e2ecd7505b17'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.096428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b4c20aea684f27a29d518feb62005c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.103204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1007/1988] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:38 2022] DELETE /identity/v3/users/91b4c20aea684f27a29d518feb62005c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:39.104042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:39.105614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.117772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:39.181641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96097a316ae2496f89c9e2ecd7505b17'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.182547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96097a316ae2496f89c9e2ecd7505b17'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.198699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 982/1989] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:38 2022] DELETE /identity/v3/users/96097a316ae2496f89c9e2ecd7505b17 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:39.199803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:39.201940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.206787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b4a8-790c-4991-af0a-9ef1743238d1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:39.293328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:39.294102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.294450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.294783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] PATH_INFO: `/v3/users/cdf93fc6bd834b7b8f79dd840a33c69e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.299285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf93fc6bd834b7b8f79dd840a33c69e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:39.299285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:39.307969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511eab1-eb49-4a96-8729-922692114463 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:39.315167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:39.315979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.316272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.316542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.317283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:39.319055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:39.330023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 983/1990] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:39.330878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:39.332786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.347021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a35ae-6d6f-49bf-b37d-faf9a6203f50 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:39.352145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9ae3-2ed5-4af2-9f56-8c8895c0d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:39.352810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9ae3-2ed5-4af2-9f56-8c8895c0d13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.353090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9ae3-2ed5-4af2-9f56-8c8895c0d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.353367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9ae3-2ed5-4af2-9f56-8c8895c0d13d admin admin] PATH_INFO: `/v3/projects/e7578be6786f46a28004d4113bc1e4ad/users/fe7784d6aa834f268a1132f84c132347/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.355332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9ae3-2ed5-4af2-9f56-8c8895c0d13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7578be6786f46a28004d4113bc1e4ad, user_id=fe7784d6aa834f268a1132f84c132347, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:39.358168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9ae3-2ed5-4af2-9f56-8c8895c0d13d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:39.378041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 984/1991] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:39 2022] PUT /identity/v3/projects/e7578be6786f46a28004d4113bc1e4ad/users/fe7784d6aa834f268a1132f84c132347/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:39.379761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.380210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.380507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.405746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:39.407047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.507423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 985/1992] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:39.507423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:39.517971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5788f0-8d58-4c34-9df0-29e0ace21deb None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:39.524483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5ab5-ef8e-427c-9c60-34ef53040ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:39.525538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5ab5-ef8e-427c-9c60-34ef53040ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.526090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5ab5-ef8e-427c-9c60-34ef53040ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.526511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5ab5-ef8e-427c-9c60-34ef53040ee6 admin admin] PATH_INFO: `/v3/projects/d1117d837fcc4ce7a31203790469cc51/users/14fdb78bad924d26b0cf484693616ffd/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.546998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5ab5-ef8e-427c-9c60-34ef53040ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1117d837fcc4ce7a31203790469cc51, user_id=14fdb78bad924d26b0cf484693616ffd, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:39.550580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5ab5-ef8e-427c-9c60-34ef53040ee6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:39.555154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf93fc6bd834b7b8f79dd840a33c69e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.555885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf93fc6bd834b7b8f79dd840a33c69e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.564364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf93fc6bd834b7b8f79dd840a33c69e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.577546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf93fc6bd834b7b8f79dd840a33c69e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.679679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 986/1993] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:39 2022] PUT /identity/v3/projects/d1117d837fcc4ce7a31203790469cc51/users/14fdb78bad924d26b0cf484693616ffd/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:39.680955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dcea8-eab4-4ccf-a71e-3dbd3c0a603f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.681240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dcea8-eab4-4ccf-a71e-3dbd3c0a603f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.688599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dcea8-eab4-4ccf-a71e-3dbd3c0a603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.710451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e73dcea8-eab4-4ccf-a71e-3dbd3c0a603f None None] MFA Rules not processed for user `fe7784d6aa834f268a1132f84c132347`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:39.711774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e73dcea8-eab4-4ccf-a71e-3dbd3c0a603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.780058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf93fc6bd834b7b8f79dd840a33c69e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:39.792485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1008/1994] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:39 2022] DELETE /identity/v3/users/cdf93fc6bd834b7b8f79dd840a33c69e => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:39.798431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 987/1995] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:39.798431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.798431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.798431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.799903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:39.802499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.864379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] MFA Rules not processed for user `14fdb78bad924d26b0cf484693616ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:39.866733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.909699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4997-c6c1-4ce6-a748-c9ef5a6d5835 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:39.914106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:39.914740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:39.915023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:39.915302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:39.917447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.956684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 988/1996] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:39.960628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:39.963165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:39.992821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:39.994855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.006411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1009/1997] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:40.011537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.015115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.042656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b7580-ae05-4a0d-980c-e1d1d3404155 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.048119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.048834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.049122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.049399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] PATH_INFO: `/v3/projects/d796283cffac486ba4c9d2ac89637f29` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.050634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d796283cffac486ba4c9d2ac89637f29)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.052701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.097078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404815-febb-4c80-966e-2188bf3c35fc service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.101877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.102524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.102839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.103076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.104964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.183882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd796283cffac486ba4c9d2ac89637f29', 'request_id': 'req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.192836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd796283cffac486ba4c9d2ac89637f29', 'request_id': 'req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.194945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.200961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.214185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1010/1998] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:40.215142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.216631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.231918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f90f5-2c8c-4124-8966-414f283a5d1d service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.278689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd796283cffac486ba4c9d2ac89637f29', 'request_id': 'req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.308167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] The token cache is being invalidate because project d796283cffac486ba4c9d2ac89637f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:40.308710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.309998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-a3f7e19d-30ef-4f8f-8a54-a450b42604b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.319960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 989/1999] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:39 2022] DELETE /identity/v3/projects/d796283cffac486ba4c9d2ac89637f29 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:40.323820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4a639-81e9-4076-8edf-8ae1f206f8ba None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.329159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4a639-81e9-4076-8edf-8ae1f206f8ba None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.329159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4a639-81e9-4076-8edf-8ae1f206f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.360402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.365496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:40.366386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.366939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.367374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.368237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.370845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-57b4a639-81e9-4076-8edf-8ae1f206f8ba None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:40.371065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.371704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-57b4a639-81e9-4076-8edf-8ae1f206f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.384287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 990/2000] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:40.394155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.396799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.397335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.433024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:40.435000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.446156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 991/2001] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:40.454894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.475729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a1d2-f881-44b2-838b-f8532df1ed5e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.483413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.484150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.484439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.484775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.485444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:40.486330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.489058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.505875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 992/2002] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:40.508356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.509390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1011/2003] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:40 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:40.510749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.512559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.515658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.531084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8337c7-54f5-4383-a366-1f75f5579eea admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.588492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77530b2-47d1-4df2-b2ba-bb2c9945c88c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.596877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.597591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.597999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.598332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.599165 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.601539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.615566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.616348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.617400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.617400 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] PATH_INFO: `/v3/projects/a50c8d581bc9404ca88e15652ee27503` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.618544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50c8d581bc9404ca88e15652ee27503)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.620548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.646780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:40.741937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1012/2004] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:40 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:40.744465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.761195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc76012-dcb4-4505-80eb-381634476f5d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.765989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.766598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.766890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.767180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.767798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.770627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:40.797966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50c8d581bc9404ca88e15652ee27503', 'request_id': 'req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.806315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50c8d581bc9404ca88e15652ee27503', 'request_id': 'req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.878096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1013/2005] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:40 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:40.882722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.885070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.896724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50c8d581bc9404ca88e15652ee27503', 'request_id': 'req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.922326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] The token cache is being invalidate because project a50c8d581bc9404ca88e15652ee27503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:40.922886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.923867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:40.926294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 993/2006] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:40 2022] DELETE /identity/v3/projects/a50c8d581bc9404ca88e15652ee27503 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:40.928047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:40.930117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:40.972547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceccef-2340-4525-befd-4874f35b5cd6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:40.977749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:40.978425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:40.978706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:40.978982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] PATH_INFO: `/v3/projects/326546a6b41e4e3abe3b20f531c47cf6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:40.980358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326546a6b41e4e3abe3b20f531c47cf6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:40.982666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.007547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d4ef-de9b-4f54-8467-0a9eb08b59c1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.012999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.014026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.014231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.014514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.015183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.017408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.032310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 994/2007] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:41.032310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.032310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.045418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e84cd-3df9-41fd-9592-b4d595776554 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.050908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ac632-b44d-443b-86a5-61ae94104dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.051431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ac632-b44d-443b-86a5-61ae94104dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.051711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ac632-b44d-443b-86a5-61ae94104dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.052033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ac632-b44d-443b-86a5-61ae94104dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.052692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ac632-b44d-443b-86a5-61ae94104dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.054826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ac632-b44d-443b-86a5-61ae94104dc4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.149603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326546a6b41e4e3abe3b20f531c47cf6', 'request_id': 'req-c4988cec-cdfc-4dc0-a939-1c612965bea5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.157079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326546a6b41e4e3abe3b20f531c47cf6', 'request_id': 'req-c4988cec-cdfc-4dc0-a939-1c612965bea5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.197126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 995/2008] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:41 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:41.199964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.200562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.201131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.233444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:41.235034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.296278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326546a6b41e4e3abe3b20f531c47cf6', 'request_id': 'req-c4988cec-cdfc-4dc0-a939-1c612965bea5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.312665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] The token cache is being invalidate because project 326546a6b41e4e3abe3b20f531c47cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:41.313051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.314346 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.316347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1014/2009] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:40 2022] DELETE /identity/v3/projects/326546a6b41e4e3abe3b20f531c47cf6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:41.325222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 996/2010] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:41.325438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.325564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.327432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.342538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5e15-7d31-4ae0-9db1-cebbc7510dfc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.349800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988cec-cdfc-4dc0-a939-1c612965bea5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.350061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.351065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.351602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.352051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.353167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.356154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.357053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55bc9f-d6ae-4884-89a6-b86ca43d6630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.358169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bc9f-d6ae-4884-89a6-b86ca43d6630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.358550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bc9f-d6ae-4884-89a6-b86ca43d6630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.359006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bc9f-d6ae-4884-89a6-b86ca43d6630 admin admin] PATH_INFO: `/v3/projects/64391264ba874b7f9d8cebcdf30aa9cd/users/917cb755d9a94f4c9b2867684bb83e27/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.371118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 997/2011] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:41.374516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.374516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.384250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55bc9f-d6ae-4884-89a6-b86ca43d6630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64391264ba874b7f9d8cebcdf30aa9cd, user_id=917cb755d9a94f4c9b2867684bb83e27, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.387326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55bc9f-d6ae-4884-89a6-b86ca43d6630 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.390692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de820-5cf2-463a-a06c-e8714bfe5ce0 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.397288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.397992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.398286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.403298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] PATH_INFO: `/v3/users/0130e0dcc2634f02ac8553aaa1705daa` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.403298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0130e0dcc2634f02ac8553aaa1705daa)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.403298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.509927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1015/2012] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:41 2022] PUT /identity/v3/projects/64391264ba874b7f9d8cebcdf30aa9cd/users/917cb755d9a94f4c9b2867684bb83e27/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:41.511280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.511630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.511915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.535628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:41.537070 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.600467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1016/2013] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:41.601401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.602802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.616471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599dbee-305c-490a-8dc4-30ab3eb5e324 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.621687 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.622342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.622628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.622945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.623695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.625327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.637323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1017/2014] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:41.638230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.650193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b61b-a19f-4549-920d-59378fda2480 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.658239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.659291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.659807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.660313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.661554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.664683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.688294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1018/2015] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:41.688494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0130e0dcc2634f02ac8553aaa1705daa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.689530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.689639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0130e0dcc2634f02ac8553aaa1705daa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.691086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.704811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0130e0dcc2634f02ac8553aaa1705daa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.714828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe83267-2126-46e8-9f93-e68e83dfef94 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.720397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.721092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.721382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.721655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.722365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:41.722669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.724309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.739274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1019/2016] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:41.740908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.743647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.761882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264a34-819e-400d-9050-4d18b99268d5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.770166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.771558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.771897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.772312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] PATH_INFO: `/v3/projects/5480039b94624998b753a2b405c90eec/users/7a70b009464f455dbad7e7954fa6374b/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:41.777980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0130e0dcc2634f02ac8553aaa1705daa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.778747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0130e0dcc2634f02ac8553aaa1705daa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:41.800600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5480039b94624998b753a2b405c90eec, user_id=7a70b009464f455dbad7e7954fa6374b, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:41.805740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 998/2017] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:41 2022] DELETE /identity/v3/users/0130e0dcc2634f02ac8553aaa1705daa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:41.806695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:41.809200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.811995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:41.901131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea0365-b60a-4bd6-bc04-eaeaffb879b0 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:41.910827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1020/2018] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:41 2022] PUT /identity/v3/projects/5480039b94624998b753a2b405c90eec/users/7a70b009464f455dbad7e7954fa6374b/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:41.912001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:41.989259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:41.995769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492801f-d841-493c-a327-cf5bf3cdfd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:41.997560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492801f-d841-493c-a327-cf5bf3cdfd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:41.997560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492801f-d841-493c-a327-cf5bf3cdfd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:41.998255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492801f-d841-493c-a327-cf5bf3cdfd7c admin admin] PATH_INFO: `/v3/projects/64391264ba874b7f9d8cebcdf30aa9cd/users/917cb755d9a94f4c9b2867684bb83e27/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.001088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7388-a6a6-4acc-96c1-c872a8eca7de admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.004186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492801f-d841-493c-a327-cf5bf3cdfd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64391264ba874b7f9d8cebcdf30aa9cd, user_id=917cb755d9a94f4c9b2867684bb83e27, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.007741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187915bb-b365-4821-a8d5-a92be11466f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.008513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187915bb-b365-4821-a8d5-a92be11466f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.009371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187915bb-b365-4821-a8d5-a92be11466f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.009371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187915bb-b365-4821-a8d5-a92be11466f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.009971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187915bb-b365-4821-a8d5-a92be11466f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.010511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492801f-d841-493c-a327-cf5bf3cdfd7c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.012066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187915bb-b365-4821-a8d5-a92be11466f7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.036011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 999/2019] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:41 2022] PUT /identity/v3/projects/64391264ba874b7f9d8cebcdf30aa9cd/users/917cb755d9a94f4c9b2867684bb83e27/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:42.038191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.038651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.039250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.044295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:42.090349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] MFA Rules not processed for user `7a70b009464f455dbad7e7954fa6374b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:42.091528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:42.128973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1021/2020] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:41 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:42.130447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.130737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.131017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.185971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] MFA Rules not processed for user `917cb755d9a94f4c9b2867684bb83e27`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:42.187969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:42.202268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1000/2021] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:42.203345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:42.305902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1022/2022] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:42.305902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:42.313558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac1e4e-6dc4-4bc8-908a-e2deac2f31fc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.388977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459bde0-cb28-4785-af85-37a645a5199f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.396181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.396911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.397258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.397525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.398305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.400501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.402108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.404858 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.409898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.409898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.409898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.414028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.510843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1023/2023] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:42 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:42.511464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:42.517535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:42.590026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1001/2024] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:42 2022] POST /identity/v3/users => generated 284 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:42.590996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:42.594685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:42.607942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8630f6c-abbd-45bf-a942-63c3cd21eb4f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.609388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e236b-af3c-449f-b9c2-4a0d1ceb8ef5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.617003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.617574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.618032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.618364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.694851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.696169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.696598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.697079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] PATH_INFO: `/v3/projects/e834105cf710442e93a9a758dfc12307` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.698178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.698602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e834105cf710442e93a9a758dfc12307)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.699909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.702228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.712665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1024/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:42.713506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:42.725997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9097-25ac-4a81-84de-fc807f913052 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.732309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516842-d58f-4969-b795-3818647669cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.732926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516842-d58f-4969-b795-3818647669cf admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.733209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516842-d58f-4969-b795-3818647669cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.733492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516842-d58f-4969-b795-3818647669cf admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.734161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516842-d58f-4969-b795-3818647669cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:42.737216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516842-d58f-4969-b795-3818647669cf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:42.832190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:42.891795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1025/2026] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:42 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:42.893284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516842-d58f-4969-b795-3818647669cf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:42.904105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e834105cf710442e93a9a758dfc12307', 'request_id': 'req-e8ddefba-e330-4284-8c63-497bfc15208d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:42.905186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516842-d58f-4969-b795-3818647669cf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:42.912299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e834105cf710442e93a9a758dfc12307', 'request_id': 'req-e8ddefba-e330-4284-8c63-497bfc15208d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:42.993404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:42.994332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:42.995064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:42.996415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:42.997482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.000187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.019273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1026/2027] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:43.022496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.033889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974a0a-f91f-41e5-a911-37bc1342d65e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.043938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e834105cf710442e93a9a758dfc12307', 'request_id': 'req-e8ddefba-e330-4284-8c63-497bfc15208d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:43.044059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.044711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.044992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.045267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.045934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.047602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.062765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1027/2028] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:43.064263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.065435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] The token cache is being invalidate because project e834105cf710442e93a9a758dfc12307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:43.065821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:43.069080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:43.075847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1002/2029] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:42 2022] DELETE /identity/v3/projects/e834105cf710442e93a9a758dfc12307 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:43.075847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.075847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:43.078589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb33b5-9447-4d0b-a3c7-61d989f5d8e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.084747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18213b0-432a-4781-9d61-6ee1c1faed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.085367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18213b0-432a-4781-9d61-6ee1c1faed05 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.085641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18213b0-432a-4781-9d61-6ee1c1faed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.086463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18213b0-432a-4781-9d61-6ee1c1faed05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.086592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18213b0-432a-4781-9d61-6ee1c1faed05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.088204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18213b0-432a-4781-9d61-6ee1c1faed05 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.090109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddefba-e330-4284-8c63-497bfc15208d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.095385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d66d3-25c5-4e15-938e-0f29edb4377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.096084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d66d3-25c5-4e15-938e-0f29edb4377e admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.096519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d66d3-25c5-4e15-938e-0f29edb4377e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.096804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d66d3-25c5-4e15-938e-0f29edb4377e admin admin] PATH_INFO: `/v3/projects/d5e38a177ded42ffaf4f659911ddda8e/users/a1ce1291cbcc43219850a54d91b579af/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.104884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1028/2030] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:43.110117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.110117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.110117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.114492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d66d3-25c5-4e15-938e-0f29edb4377e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e38a177ded42ffaf4f659911ddda8e, user_id=a1ce1291cbcc43219850a54d91b579af, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.117465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d66d3-25c5-4e15-938e-0f29edb4377e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.128756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:43.130024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:43.138452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1029/2031] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:43.139217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.140662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:43.158161 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba31b2-c9a7-4eeb-bbb9-c8e6331f8cdd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.163545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.164290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.164566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.164849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] PATH_INFO: `/v3/projects/0c0f45d985e54adf94e6cd9cb0d7d126/users/284c7531c80a4b73af722318e124e00c/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.194008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0f45d985e54adf94e6cd9cb0d7d126, user_id=284c7531c80a4b73af722318e124e00c, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.194008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.258592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1003/2032] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:43 2022] PUT /identity/v3/projects/d5e38a177ded42ffaf4f659911ddda8e/users/a1ce1291cbcc43219850a54d91b579af/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:43.259157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e43c-b715-48ec-abd4-c647b6929f06 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.259543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e43c-b715-48ec-abd4-c647b6929f06 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.259823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e43c-b715-48ec-abd4-c647b6929f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.279943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9686e43c-b715-48ec-abd4-c647b6929f06 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:43.281161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9686e43c-b715-48ec-abd4-c647b6929f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:43.301128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1030/2033] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:43 2022] PUT /identity/v3/projects/0c0f45d985e54adf94e6cd9cb0d7d126/users/284c7531c80a4b73af722318e124e00c/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:43.305470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.382064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1004/2034] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:43.383574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.383927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.384274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.396694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5207-eb80-463b-8c4f-b2e651034f7e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.403952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.404636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.404918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.405199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.405875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.407567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.422222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1031/2035] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:43.422222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.425774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] MFA Rules not processed for user `284c7531c80a4b73af722318e124e00c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:43.428653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:43.429564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:43.432919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d102-b954-4e7a-a229-d63358084bf7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.438736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.439851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.440138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.443287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.443287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:43.443287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.443287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.459640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1032/2036] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:43.460783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.477676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d5c7b-271f-41d9-a183-71cba0cc0c8f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.509522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.509883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.510174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.510452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] PATH_INFO: `/v3/projects/d5e38a177ded42ffaf4f659911ddda8e/users/a1ce1291cbcc43219850a54d91b579af/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.514226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e38a177ded42ffaf4f659911ddda8e, user_id=a1ce1291cbcc43219850a54d91b579af, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.517446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.545976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1033/2038] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:43 2022] PUT /identity/v3/projects/d5e38a177ded42ffaf4f659911ddda8e/users/a1ce1291cbcc43219850a54d91b579af/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:43.545976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.547455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1005/2038] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:43.549220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.561790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc094b-7d79-4364-81ca-6a201486e228 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.655438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed9966-5f22-4781-96ec-6aa12a44408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.655761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9966-5f22-4781-96ec-6aa12a44408d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.656026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9966-5f22-4781-96ec-6aa12a44408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.660068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed9966-5f22-4781-96ec-6aa12a44408d admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.660068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed9966-5f22-4781-96ec-6aa12a44408d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.660506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56e7c-86a2-46d1-8ea5-a24eca7a0053 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.662801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed9966-5f22-4781-96ec-6aa12a44408d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.679894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.680580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.680918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.681166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.681787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.684167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.854566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1006/2039] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:43.854566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.854566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.854566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.858790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1034/2040] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:43.859703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:43.895704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] MFA Rules not processed for user `a1ce1291cbcc43219850a54d91b579af`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:43.896971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:43.956641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9976a-ab79-4b21-959d-7015a19b0fed admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:43.964295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:43.965267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:43.965741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:43.966249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:43.967241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:43.969647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:43.990055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1007/2041] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:43.991112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.007205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c64eb-d341-43f5-ac26-21d9743142e2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.009177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.010041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.010327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.010603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.011307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.013563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.093455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1035/2042] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:44.095589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.098972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:44.165169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1008/2043] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:43 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:44.166448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.176316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c832a36-bf71-4546-8969-95d13d83c332 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.179567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371491d-e37e-4018-b3fe-acc1cc9f0470 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.182187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.182812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.183126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.183415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.191930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.198370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.198370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.198370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.198370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.199983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.202743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.204438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.220597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1036/2044] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:44.221484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.226564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1009/2045] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:44.228218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.255242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f0513-c2e4-45d9-94a2-dfcc4ecfce21 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.258014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7d7ec-3906-47d5-b4e1-29eb5c4f4050 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.259347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.260524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.261110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.262126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.263118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.263673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.264397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.264690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.264971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] PATH_INFO: `/v3/projects/1dd838fd28be49c995a8a0a2b64cb240/users/a64b583128a3420c9f235c7b73e4228f/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.266681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.287429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd838fd28be49c995a8a0a2b64cb240, user_id=a64b583128a3420c9f235c7b73e4228f, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.288367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1037/2046] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:44.289889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.291034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.309194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdf681-1996-459b-a636-15b6953bc6cd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.317373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.318476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.318990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.319484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.320612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.323566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.343633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1038/2047] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:44.353109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.363896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d8591-fb58-42d4-9e0a-cbb9c5550817 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.369258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.369979 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.373664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.373664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] PATH_INFO: `/v3/projects/59d66e45d06e406ea1ca9980b038e373/users/b211b2f5bbc14194980cbe3503e5199d/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.387722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d66e45d06e406ea1ca9980b038e373, user_id=b211b2f5bbc14194980cbe3503e5199d, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.390453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.428834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1010/2048] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:44 2022] PUT /identity/v3/projects/1dd838fd28be49c995a8a0a2b64cb240/users/a64b583128a3420c9f235c7b73e4228f/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:44.435624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.480195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:44.537175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd58b7-9729-4431-965e-3da9ca07bb21 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.542005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.542650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.542918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.543194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.543878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.545555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.559730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1039/2049] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:44 2022] PUT /identity/v3/projects/59d66e45d06e406ea1ca9980b038e373/users/b211b2f5bbc14194980cbe3503e5199d/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:44.563315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.568357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1011/2050] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:44.570803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.594757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b803633-ddce-41f1-9f2b-429d03f97974 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.629789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072f087-454b-4400-a7b1-767948d4f8f6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.635164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.635822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.636098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.636373 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.638942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:44.693983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3886a3-d0be-4644-9b22-e229fe9738ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.694889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3886a3-d0be-4644-9b22-e229fe9738ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.695165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3886a3-d0be-4644-9b22-e229fe9738ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.695442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3886a3-d0be-4644-9b22-e229fe9738ce admin admin] PATH_INFO: `/v3/projects/1dd838fd28be49c995a8a0a2b64cb240/users/a64b583128a3420c9f235c7b73e4228f/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.697490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3886a3-d0be-4644-9b22-e229fe9738ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd838fd28be49c995a8a0a2b64cb240, user_id=a64b583128a3420c9f235c7b73e4228f, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.700248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3886a3-d0be-4644-9b22-e229fe9738ce admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.715161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1012/2051] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:44 2022] PUT /identity/v3/projects/1dd838fd28be49c995a8a0a2b64cb240/users/a64b583128a3420c9f235c7b73e4228f/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:44.716946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967caf-d923-4702-90c1-dcc4cb3841fd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.717255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967caf-d923-4702-90c1-dcc4cb3841fd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.717508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72967caf-d923-4702-90c1-dcc4cb3841fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.726605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.728573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.741440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1040/2052] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:44.742581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.744125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:44.757795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-72967caf-d923-4702-90c1-dcc4cb3841fd None None] MFA Rules not processed for user `b211b2f5bbc14194980cbe3503e5199d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:44.757795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-72967caf-d923-4702-90c1-dcc4cb3841fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:44.761976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cf5f-7c75-4f5a-bc5a-a1508f71a4bf service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:44.858641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1013/2053] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:44.858641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.858641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.858641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.862209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:44.862957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:44.863238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:44.863513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] PATH_INFO: `/v3/users/14fdb78bad924d26b0cf484693616ffd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:44.866843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fdb78bad924d26b0cf484693616ffd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:44.866843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:44.898935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] MFA Rules not processed for user `a64b583128a3420c9f235c7b73e4228f`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:44.900271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:44.982719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1014/2054] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:44.990238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:44.994509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.012088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6ba73-c03b-4ca7-bdae-40e0d0f919fe None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.017783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.018476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.018761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.019039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] PATH_INFO: `/v3/users/879342ff5bf24debad4ce7f65800273e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.020322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=879342ff5bf24debad4ce7f65800273e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.022389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.028596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:45.104677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fdb78bad924d26b0cf484693616ffd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.105394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fdb78bad924d26b0cf484693616ffd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.117626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fdb78bad924d26b0cf484693616ffd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.132089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fdb78bad924d26b0cf484693616ffd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.210754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fdb78bad924d26b0cf484693616ffd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.217922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1041/2055] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:44 2022] DELETE /identity/v3/users/14fdb78bad924d26b0cf484693616ffd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:45.218762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.220695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.282283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879342ff5bf24debad4ce7f65800273e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.283845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879342ff5bf24debad4ce7f65800273e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.297841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879342ff5bf24debad4ce7f65800273e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.299607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5863f2e-8c88-499a-9ac7-b7c67f92f262 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.309289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.310427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.313063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.313063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.313063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.316332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.488514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879342ff5bf24debad4ce7f65800273e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.490429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-61ae3182-0fc8-40f5-9aae-04261d82f3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879342ff5bf24debad4ce7f65800273e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:45.499322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1042/2056] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:45 2022] POST /identity/v3/projects => generated 379 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:45.499322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.499322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.504817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1015/2057] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:44 2022] DELETE /identity/v3/users/879342ff5bf24debad4ce7f65800273e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:45.506163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.506448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.506777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.527523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:45.528766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.570773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dab48-73ec-4007-9383-0127729a9ae0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.596019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1016/2058] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:45.596930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.601766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.614454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43be68-1b5a-441a-b47c-e6ffdfaf0925 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.620003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a0572-cde5-4aaf-96a8-1d7aea8090b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.620283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a0572-cde5-4aaf-96a8-1d7aea8090b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.620623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a0572-cde5-4aaf-96a8-1d7aea8090b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.621056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a0572-cde5-4aaf-96a8-1d7aea8090b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.621684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a0572-cde5-4aaf-96a8-1d7aea8090b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.623619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a0572-cde5-4aaf-96a8-1d7aea8090b0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.635395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.636445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.636899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.637340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.639786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.714987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1017/2059] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:45 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:45.716504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.716995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.717332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.720478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.722162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.736375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1043/2060] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:45.738921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.740836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:45.741750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.742309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.751538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1018/2061] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:45.756123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.769823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6a1e-0850-4a69-87c7-935cad86dd07 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.777129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.778032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.778515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.778796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.779606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.782272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.798675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1019/2062] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:45.799984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.802063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:45.827465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24100017-914c-4eca-97f9-306a802b52c7 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.832954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.832954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.832954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.837721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.843310 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.844829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.855984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1044/2063] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:45.856889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.867110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99ae98-7d44-4b21-b392-142c8bccef46 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.872519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.873269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.873557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.873838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.874595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.876784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.886219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b86a8-defd-4110-957b-aa527cb84cc3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.892509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50747e-5a12-482c-8ea6-9d958488efe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.893267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50747e-5a12-482c-8ea6-9d958488efe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.893642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50747e-5a12-482c-8ea6-9d958488efe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.894048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50747e-5a12-482c-8ea6-9d958488efe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.896258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1045/2064] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:45.897208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:45.906835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50747e-5a12-482c-8ea6-9d958488efe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.908963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50747e-5a12-482c-8ea6-9d958488efe3 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:45.916693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4d9f-0ce3-4451-9da9-e658df67364c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:45.917445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:45.918000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:45.918244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:45.918548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] PATH_INFO: `/v3/projects/7e109a884b2249c886d98d9a6af8f43c/users/20cf14540f964f7aa2801bcb81864c74/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:45.934916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1020/2065] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:45.936973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e109a884b2249c886d98d9a6af8f43c, user_id=20cf14540f964f7aa2801bcb81864c74, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:45.940808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:46.097621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1046/2066] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:45 2022] PUT /identity/v3/projects/7e109a884b2249c886d98d9a6af8f43c/users/20cf14540f964f7aa2801bcb81864c74/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:46.108575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:46.108860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:46.109138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:46.115095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:46.210642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] MFA Rules not processed for user `20cf14540f964f7aa2801bcb81864c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:46.212142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:46.286575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c144355-a742-4897-8517-85e987e61b95 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:46.292183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:46.292829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:46.293114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:46.293392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:46.295581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:46.349161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1021/2067] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:46.354230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:46.437272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:46.438604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:46.441029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:46.452771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1047/2068] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:46.493843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bc823-ec51-46b0-beb5-4023325324d1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:46.498816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:46.499619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:46.499907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:46.500185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:46.500824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:46.503458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:46.586346 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:46.603995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:46.625640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1022/2069] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:46 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:46.627441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:46.635071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:46.648457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6e52-4cc4-4ede-8bc6-232257ea15ec service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:46.748300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:46.749598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:46.750118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:46.750658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] PATH_INFO: `/v3/projects/d1117d837fcc4ce7a31203790469cc51` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:46.753279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1117d837fcc4ce7a31203790469cc51)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:46.756927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:46.790552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54459622-4e2d-4dc4-9210-f5e93515b71d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:46.796174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:46.796836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:46.797113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:46.797391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] PATH_INFO: `/v3/projects/39b30d79cc374681a69ef2801227a02d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:46.798765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b30d79cc374681a69ef2801227a02d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:46.801272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:46.886439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1117d837fcc4ce7a31203790469cc51', 'request_id': 'req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.893572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1117d837fcc4ce7a31203790469cc51', 'request_id': 'req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.962550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b30d79cc374681a69ef2801227a02d', 'request_id': 'req-cb763f34-729f-4f56-90f6-e3133649ba3f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.965988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1117d837fcc4ce7a31203790469cc51', 'request_id': 'req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.975270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b30d79cc374681a69ef2801227a02d', 'request_id': 'req-cb763f34-729f-4f56-90f6-e3133649ba3f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.981500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] The token cache is being invalidate because project d1117d837fcc4ce7a31203790469cc51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:46.981875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.982630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:46.984355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1048/2070] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:46 2022] DELETE /identity/v3/projects/d1117d837fcc4ce7a31203790469cc51 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:46.989545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:46.989545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:47.064342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0dd3b-d618-4c1e-a598-891fb68d0ed4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:47.067935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b30d79cc374681a69ef2801227a02d', 'request_id': 'req-cb763f34-729f-4f56-90f6-e3133649ba3f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.090310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] The token cache is being invalidate because project 39b30d79cc374681a69ef2801227a02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:47.091345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.092458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.094915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1023/2071] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:46 2022] DELETE /identity/v3/projects/39b30d79cc374681a69ef2801227a02d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:47.096593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:47.099222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:47.144131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:47.144645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:47.144919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:47.145196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:47.145873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:47.147895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:47.179140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb763f34-729f-4f56-90f6-e3133649ba3f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:47.184285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:47.184949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:47.185348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:47.185645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] PATH_INFO: `/v3/users/917cb755d9a94f4c9b2867684bb83e27` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:47.187008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917cb755d9a94f4c9b2867684bb83e27)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:47.189716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:47.262892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1049/2072] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:46 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:47.263773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:47.271933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:47.279112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05a16-8b57-411e-b86e-493fa38abda7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:47.285294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:47.285976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:47.286258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:47.286560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] PATH_INFO: `/v3/users/fe7784d6aa834f268a1132f84c132347` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:47.287938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7784d6aa834f268a1132f84c132347)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:47.290367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:47.512660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917cb755d9a94f4c9b2867684bb83e27'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.513770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917cb755d9a94f4c9b2867684bb83e27'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.542741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917cb755d9a94f4c9b2867684bb83e27'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.593788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7784d6aa834f268a1132f84c132347'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.597820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7784d6aa834f268a1132f84c132347'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.614991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7784d6aa834f268a1132f84c132347'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.640336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7784d6aa834f268a1132f84c132347'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.643142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917cb755d9a94f4c9b2867684bb83e27'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.643776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917cb755d9a94f4c9b2867684bb83e27'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.669033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1024/2073] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:47 2022] DELETE /identity/v3/users/917cb755d9a94f4c9b2867684bb83e27 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:47.670115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:47.675916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:47.711580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:47.741406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7784d6aa834f268a1132f84c132347'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:47.755540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1050/2074] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:47 2022] DELETE /identity/v3/users/fe7784d6aa834f268a1132f84c132347 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:47.831679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0711b4-3ca6-4da6-97ec-2da60dbb6fa9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:47.911085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:47.911962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:47.912077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:47.912765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:47.913007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:47.915496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:47.930715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1025/2075] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:47.932106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:47.934800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:47.951616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0388-fdf1-4e65-aca5-f1ce1e72a669 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:47.957487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:47.958214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:47.958495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:47.958771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] PATH_INFO: `/v3/projects/77dc0a7b0897433797a853ceddadb8e9/users/33515367b81c426ab19ef9690cdef002/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:47.991139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dc0a7b0897433797a853ceddadb8e9, user_id=33515367b81c426ab19ef9690cdef002, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:47.994078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.109026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1051/2076] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:47 2022] PUT /identity/v3/projects/77dc0a7b0897433797a853ceddadb8e9/users/33515367b81c426ab19ef9690cdef002/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:48.113324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.126881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9c53-52ac-42e3-82f5-da6e2499681c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.198771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.199603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.200023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.200458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.201726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.208158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.219610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.232997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.247132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1026/2077] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:48.249527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.254678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f319-1859-4635-b6bb-062145da9459 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.259525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.260194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.260454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.260889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] PATH_INFO: `/v3/projects/64391264ba874b7f9d8cebcdf30aa9cd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.262658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64391264ba874b7f9d8cebcdf30aa9cd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.265541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.273980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09630f6-ba85-4434-87ee-878de8fb82af admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.290571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a873d2-680a-41b5-b7d9-bc0fccc37c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.292136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a873d2-680a-41b5-b7d9-bc0fccc37c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.292820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a873d2-680a-41b5-b7d9-bc0fccc37c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.293508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a873d2-680a-41b5-b7d9-bc0fccc37c70 admin admin] PATH_INFO: `/v3/projects/77dc0a7b0897433797a853ceddadb8e9/users/33515367b81c426ab19ef9690cdef002/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.298649 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a873d2-680a-41b5-b7d9-bc0fccc37c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dc0a7b0897433797a853ceddadb8e9, user_id=33515367b81c426ab19ef9690cdef002, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.306717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a873d2-680a-41b5-b7d9-bc0fccc37c70 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.326310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1027/2078] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:48 2022] PUT /identity/v3/projects/77dc0a7b0897433797a853ceddadb8e9/users/33515367b81c426ab19ef9690cdef002/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:48.338563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.339046 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.339471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.377260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] MFA Rules not processed for user `33515367b81c426ab19ef9690cdef002`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:48.378893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.417914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64391264ba874b7f9d8cebcdf30aa9cd', 'request_id': 'req-dec13244-84b2-4c8e-93fa-120c484ad48e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.429518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64391264ba874b7f9d8cebcdf30aa9cd', 'request_id': 'req-dec13244-84b2-4c8e-93fa-120c484ad48e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.490720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1028/2079] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:48.504803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.506359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.540310 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64391264ba874b7f9d8cebcdf30aa9cd', 'request_id': 'req-dec13244-84b2-4c8e-93fa-120c484ad48e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.567922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] The token cache is being invalidate because project 64391264ba874b7f9d8cebcdf30aa9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:48.568199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.569053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-dec13244-84b2-4c8e-93fa-120c484ad48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.571142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1052/2080] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:48 2022] DELETE /identity/v3/projects/64391264ba874b7f9d8cebcdf30aa9cd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:48.576042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.576344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.577665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.592231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce4bd5-3f50-4593-bbc1-f3cac1df17b8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.611974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:48.615242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.666085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.666990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.667273 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.667555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.669504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.704460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1053/2081] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:48.705785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.707315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.720170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6c810-6e83-4ee8-aa48-a5f62bb760ec None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.726880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.727420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.727793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.728138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] PATH_INFO: `/v3/projects/e7578be6786f46a28004d4113bc1e4ad` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.729424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7578be6786f46a28004d4113bc1e4ad)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.731564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.763484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.767554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899f62c-4b0e-46c6-a73f-844d06878c6e service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.783892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1029/2082] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:48.785548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.785866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.786305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.812301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:48.813176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:48.822747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1030/2083] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:48.826714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.836700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f835b03-19c8-4654-8a84-1d0452efa778 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.842706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.843328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.843612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.843888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.844557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:48.845364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.847368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.862047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1031/2084] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:09:48.866405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:48.880813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048aef-aabc-4dd7-8a18-f9a31467ef6d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:48.895157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7578be6786f46a28004d4113bc1e4ad', 'request_id': 'req-3e86c698-4c3e-4a7d-a6fb-4414da327a56'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.903879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7578be6786f46a28004d4113bc1e4ad', 'request_id': 'req-3e86c698-4c3e-4a7d-a6fb-4414da327a56'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:48.960003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258ead-46ba-4e17-8879-f88693b91bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:48.960622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258ead-46ba-4e17-8879-f88693b91bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:48.960946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258ead-46ba-4e17-8879-f88693b91bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:48.961183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258ead-46ba-4e17-8879-f88693b91bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:48.961993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258ead-46ba-4e17-8879-f88693b91bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:48.964006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258ead-46ba-4e17-8879-f88693b91bfb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:48.978463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:49.034329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7578be6786f46a28004d4113bc1e4ad', 'request_id': 'req-3e86c698-4c3e-4a7d-a6fb-4414da327a56'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:49.047543 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] The token cache is being invalidate because project e7578be6786f46a28004d4113bc1e4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:49.048628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:49.049499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:49.051427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1054/2085] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:48 2022] DELETE /identity/v3/projects/e7578be6786f46a28004d4113bc1e4ad => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:49.052307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.055758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:49.077269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:49.086345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1032/2086] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:48 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:49.087873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.101583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.101583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.113390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:49.114712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:49.154654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86c698-4c3e-4a7d-a6fb-4414da327a56 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.211131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1033/2087] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:49.212343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.213979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:49.229874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1293e-1f43-48d9-b768-4df5a5d5b4d1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.231826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.232459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.232944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.233515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.236276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:49.241712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.242835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.243341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.243892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.245550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.249395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.311125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.312628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0b03b-4e1e-42f6-b928-0b7fe1caaf6b service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.322995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1055/2088] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:49.324329 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.324605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.324879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.347786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:49.349008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:49.359833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1056/2089] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:49.364849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.374588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1034/2090] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:49.376715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc60e98-d212-49d2-8594-8c66fd6fd96d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.379016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.382847 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.383473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.383756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.384034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.384754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:49.385378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.387096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.400508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161229-5aea-49dc-beb3-7cbb2885c3e5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.401886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1057/2091] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:09:49.406730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.411949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.412617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.412899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.414625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.414625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.415468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.421319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e30d6-4112-4c52-be1c-b031bc0c32c8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.430460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1035/2092] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:49.432863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.433705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.434214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.434520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.435931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.436616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.439102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.453556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9dc7c-18cc-421d-b46c-172a0f9723d8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.462970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.463751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.464196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.464611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.465521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.467585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.491227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1036/2093] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:49.495362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.515728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec460fe0-f946-4ed8-ae41-91f4b079cb51 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.515728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909223a2-c92d-4cd2-94e4-65257a37689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.515728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909223a2-c92d-4cd2-94e4-65257a37689f admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.515728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909223a2-c92d-4cd2-94e4-65257a37689f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.518316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909223a2-c92d-4cd2-94e4-65257a37689f admin admin] PATH_INFO: `/v3/projects/8a3a768c09964bd2ac4a35d944586010/users/521bf7c38f9a4c5085f3c7559d4798a7/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.548510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1058/2094] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:49.554179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.583020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909223a2-c92d-4cd2-94e4-65257a37689f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3a768c09964bd2ac4a35d944586010, user_id=521bf7c38f9a4c5085f3c7559d4798a7, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.590267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909223a2-c92d-4cd2-94e4-65257a37689f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.670443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1037/2095] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:49 2022] PUT /identity/v3/projects/8a3a768c09964bd2ac4a35d944586010/users/521bf7c38f9a4c5085f3c7559d4798a7/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:49.676658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ee76b-c083-4dce-b065-beb093b564d0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.679735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.679962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.680235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.742959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] MFA Rules not processed for user `521bf7c38f9a4c5085f3c7559d4798a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:49.747862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:49.820657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.821426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.821792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.822292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.822946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.824909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.851895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1038/2096] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:49.856515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.868899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bbda8-4972-4beb-98c8-c52c8b8db5a9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.873889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.878568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.878568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.878568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.878568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.878568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:49.969437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1059/2097] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/users => generated 288 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:49.974554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:49.986429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696d024-5966-4373-9d9e-c57c3d6e687c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:49.991319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:49.991947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:49.992241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:49.992497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:49.993187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:49.994879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.012708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1039/2098] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:49 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:50.014036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.027454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1060/2099] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:50.032662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.046869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56070cea-f749-4c59-8c20-eaa1815661de admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.104256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfdb8-eb13-49ca-904b-e362dfa34fcb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.111771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.112460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.112747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.113024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.113740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.116277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.158526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.159753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.160014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.160286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.162774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.165056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.184723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1061/2100] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:50.186108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.202660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fc2f6-d4ea-46d0-b1ab-cbe00c868cb2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.206551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1040/2101] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:50 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:50.208032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.212581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56621c-1b2e-4c44-ac40-4137335e2d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.213453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56621c-1b2e-4c44-ac40-4137335e2d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.214719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56621c-1b2e-4c44-ac40-4137335e2d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.215145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56621c-1b2e-4c44-ac40-4137335e2d1a admin admin] PATH_INFO: `/v3/projects/133652e51dc542f9a5ac6cc44c4d8bb5/users/960e90a7bcef42ffb2712cb3a97929fb/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.221583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823b73-dac7-4669-badf-aa09334493c1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.227919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.228552 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.228837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.229120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.229773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.231606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.235231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56621c-1b2e-4c44-ac40-4137335e2d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=133652e51dc542f9a5ac6cc44c4d8bb5, user_id=960e90a7bcef42ffb2712cb3a97929fb, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.238909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56621c-1b2e-4c44-ac40-4137335e2d1a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.244586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1041/2102] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:50.248263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.259525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae4e66-c4de-4c3a-afd9-1407eef25398 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.264943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.265892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.266116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.266402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] PATH_INFO: `/v3/projects/6b5248825d6d4748bb0fee41daea3606/users/5435f941b58048a8be47cba8f451abcf/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.289229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5248825d6d4748bb0fee41daea3606, user_id=5435f941b58048a8be47cba8f451abcf, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.293688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.308535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1062/2103] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:50 2022] PUT /identity/v3/projects/133652e51dc542f9a5ac6cc44c4d8bb5/users/960e90a7bcef42ffb2712cb3a97929fb/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:50.327422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.327715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.327989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.362261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] MFA Rules not processed for user `960e90a7bcef42ffb2712cb3a97929fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:50.363229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:50.440135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1042/2104] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:50 2022] PUT /identity/v3/projects/6b5248825d6d4748bb0fee41daea3606/users/5435f941b58048a8be47cba8f451abcf/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:50.444260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.446268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:50.530201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1063/2105] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:50.533332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6940692-e70e-4e3e-886b-61e5794324c7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.550080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.551114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.551577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.552030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.554687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.559157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.579447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1043/2106] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:50.584009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.680270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:50.753559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a8d5-c91e-4a8e-be1c-2e8d33fb610f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.765469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227c8ee-8a8a-446a-959e-d3172d86f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.766417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c8ee-8a8a-446a-959e-d3172d86f036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.767418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c8ee-8a8a-446a-959e-d3172d86f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.767909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c8ee-8a8a-446a-959e-d3172d86f036 admin admin] PATH_INFO: `/v3/projects/6b5248825d6d4748bb0fee41daea3606/users/5435f941b58048a8be47cba8f451abcf/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.775123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227c8ee-8a8a-446a-959e-d3172d86f036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5248825d6d4748bb0fee41daea3606, user_id=5435f941b58048a8be47cba8f451abcf, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:50.778105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227c8ee-8a8a-446a-959e-d3172d86f036 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:50.808568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1064/2107] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:50 2022] PUT /identity/v3/projects/6b5248825d6d4748bb0fee41daea3606/users/5435f941b58048a8be47cba8f451abcf/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:50.822922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.823420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.823806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.833559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d3d3a-bb3a-42ed-94fc-e544e5496144 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:50.866135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] MFA Rules not processed for user `5435f941b58048a8be47cba8f451abcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:50.867494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:50.917373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:50.918002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:50.918392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:50.918755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:50.959616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1065/2108] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:51.033494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:51.036089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:51.054371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1044/2109] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:51.217047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:51.571649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:51.575008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:51.613142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6792c05-4b43-439d-b91b-e473a4d1d4bf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:51.632963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed445841-4f7b-4abc-aac2-a0f4c07ebde9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:51.633836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed445841-4f7b-4abc-aac2-a0f4c07ebde9 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:51.634237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed445841-4f7b-4abc-aac2-a0f4c07ebde9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:51.634645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed445841-4f7b-4abc-aac2-a0f4c07ebde9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:51.651554 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed445841-4f7b-4abc-aac2-a0f4c07ebde9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:51.654566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed445841-4f7b-4abc-aac2-a0f4c07ebde9 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:51.670234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1066/2110] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:09:51.697303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:52.063081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.087521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b64d-1b48-47de-bcde-3b1bf3e8c558 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.095497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.096962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.097837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.098408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.193350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.194938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.205414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1045/2111] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:52.302318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:52.907681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.235936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.237179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.237986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.273887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] MFA Rules not processed for user `960e90a7bcef42ffb2712cb3a97929fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:53.276093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:53.293397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1067/2112] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:53.496139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.536463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.542222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:53.561318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.562339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.671976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dea621-f68c-4325-8071-1c8051dc0463 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.672254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f8bcd-b8c6-4781-ad06-bfd4629a2ea5 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.677242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.677974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.678211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.678305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.678588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] PATH_INFO: `/v3/users/521bf7c38f9a4c5085f3c7559d4798a7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.679380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.679806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.680025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521bf7c38f9a4c5085f3c7559d4798a7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.680381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] PATH_INFO: `/v3/users/33a0401f0b9d4a33afc87c794cd681d4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.681752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a0401f0b9d4a33afc87c794cd681d4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.682016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.684613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:54.067813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a0401f0b9d4a33afc87c794cd681d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.070524 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a0401f0b9d4a33afc87c794cd681d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.099710 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a0401f0b9d4a33afc87c794cd681d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.104221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521bf7c38f9a4c5085f3c7559d4798a7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.104803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521bf7c38f9a4c5085f3c7559d4798a7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.121940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521bf7c38f9a4c5085f3c7559d4798a7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.160063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521bf7c38f9a4c5085f3c7559d4798a7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.194399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a0401f0b9d4a33afc87c794cd681d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.195487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7551d33-7e4c-4019-8889-2bff9d8e12c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a0401f0b9d4a33afc87c794cd681d4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.217238 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1046/2113] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:53 2022] DELETE /identity/v3/users/33a0401f0b9d4a33afc87c794cd681d4 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:54.337841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521bf7c38f9a4c5085f3c7559d4798a7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.350299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1068/2114] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:53 2022] DELETE /identity/v3/users/521bf7c38f9a4c5085f3c7559d4798a7 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:54.355115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:54.355406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:54.355690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:54.455568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:54.463215 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:54.529746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1047/2115] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:54.540206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:54.541635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:54.603531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ff97-a2fa-4f45-aca0-8f2a9de286d5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:54.607633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821136f-15ba-4c7f-b5eb-92762ff6c449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:54.608422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821136f-15ba-4c7f-b5eb-92762ff6c449 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:54.618622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:54.620619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:54.623881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821136f-15ba-4c7f-b5eb-92762ff6c449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:54.624213 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821136f-15ba-4c7f-b5eb-92762ff6c449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:54.643236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24cf61-06e6-4bc4-a3b7-271637590be1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:54.656107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821136f-15ba-4c7f-b5eb-92762ff6c449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:54.658298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821136f-15ba-4c7f-b5eb-92762ff6c449 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:54.663555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:54.666747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:54.667179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:54.668845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] PATH_INFO: `/v3/projects/37cd0347d9cd4b9cbfa90653f033cbcc` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:54.672703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1069/2116] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:54.673993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cd0347d9cd4b9cbfa90653f033cbcc)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:54.676428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:54.747868 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:54.816660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cd0347d9cd4b9cbfa90653f033cbcc', 'request_id': 'req-87e4bdfa-55f7-4040-8574-43e991b64ef6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.823925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cd0347d9cd4b9cbfa90653f033cbcc', 'request_id': 'req-87e4bdfa-55f7-4040-8574-43e991b64ef6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.830718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:54.924497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cd0347d9cd4b9cbfa90653f033cbcc', 'request_id': 'req-87e4bdfa-55f7-4040-8574-43e991b64ef6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.941773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] The token cache is being invalidate because project 37cd0347d9cd4b9cbfa90653f033cbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:54.942204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.943089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-87e4bdfa-55f7-4040-8574-43e991b64ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:54.949605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1048/2117] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:54 2022] DELETE /identity/v3/projects/37cd0347d9cd4b9cbfa90653f033cbcc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:54.951314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:54.951508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:54.951791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:54.977162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:54.978528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:55.082552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1070/2118] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:55.089875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.090156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.090433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.117026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:55.118389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:55.128717 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1049/2119] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:55.141389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:55.144331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb778b-4b20-4389-bcac-cc2478707f51 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:55.149685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:55.150419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.150708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.151001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.151999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:55.152465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:55.154129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:55.170385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:55.170385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:55.177055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1071/2120] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:55.181484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:55.186859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdc26f-f802-4936-8a5a-4f7d93cdbf0e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:55.194197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:55.195081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.195306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73875fbe-abc6-49c3-88ec-1b8cff1db5f4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:55.195691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.196046 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] PATH_INFO: `/v3/projects/8a3a768c09964bd2ac4a35d944586010` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.202195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3a768c09964bd2ac4a35d944586010)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:55.202195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:55.202505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:55.202505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.202505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.202505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.203512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:55.205498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:55.378813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1072/2121] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:55 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:55.380047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:55.382950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:55.419753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3a768c09964bd2ac4a35d944586010', 'request_id': 'req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.431964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3a768c09964bd2ac4a35d944586010', 'request_id': 'req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.478903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c60a-84a7-410a-9925-69faaaa62813 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:55.520146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3a768c09964bd2ac4a35d944586010', 'request_id': 'req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.552165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] The token cache is being invalidate because project 8a3a768c09964bd2ac4a35d944586010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:55.552764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.553476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.558731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1050/2122] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:55 2022] DELETE /identity/v3/projects/8a3a768c09964bd2ac4a35d944586010 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:55.560286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:55.562471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:55.565066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:55.566513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.567129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.567621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] PATH_INFO: `/v3/users/b211b2f5bbc14194980cbe3503e5199d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.569586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b211b2f5bbc14194980cbe3503e5199d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:55.573309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:55.583318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129bdc6-6a09-44a3-b3dc-a77b159a5efa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:55.590788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:55.591753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.592117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.592546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.593272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:55.596352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:55.721018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1051/2123] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:55 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:55.721018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:55.724706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:55.733607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b2ab-80af-44ed-8ab6-392df3fc87fe admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:55.738924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:55.739539 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:55.739820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:55.740111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] PATH_INFO: `/v3/users/5435f941b58048a8be47cba8f451abcf` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:55.741268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5435f941b58048a8be47cba8f451abcf)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:55.743211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:55.853591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b211b2f5bbc14194980cbe3503e5199d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.854266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b211b2f5bbc14194980cbe3503e5199d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.861997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b211b2f5bbc14194980cbe3503e5199d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.888317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b211b2f5bbc14194980cbe3503e5199d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.956517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5435f941b58048a8be47cba8f451abcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.957224 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5435f941b58048a8be47cba8f451abcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:55.971393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5435f941b58048a8be47cba8f451abcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:56.004782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b211b2f5bbc14194980cbe3503e5199d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:56.013155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1073/2124] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:55 2022] DELETE /identity/v3/users/b211b2f5bbc14194980cbe3503e5199d => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:56.014122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.015455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.061611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:56.091945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72ae41-67f8-47eb-b78d-13cf4e5a7f6b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:56.097571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0006fb4-63cd-4d88-95ba-5bc1d54cf6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:56.098264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0006fb4-63cd-4d88-95ba-5bc1d54cf6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.098551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0006fb4-63cd-4d88-95ba-5bc1d54cf6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.098826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0006fb4-63cd-4d88-95ba-5bc1d54cf6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.099735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0006fb4-63cd-4d88-95ba-5bc1d54cf6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:56.101365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0006fb4-63cd-4d88-95ba-5bc1d54cf6e9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:56.112393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1074/2125] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:56.113658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.113976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.114313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.117352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5435f941b58048a8be47cba8f451abcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:56.118249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5435f941b58048a8be47cba8f451abcf'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:56.134852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1052/2126] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:55 2022] DELETE /identity/v3/users/5435f941b58048a8be47cba8f451abcf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:56.136176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.138167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.139226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:56.139873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.152438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:56.222266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1075/2127] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:56.244485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.247516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.259941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5fa3-e7cc-4fec-83cf-7ccc7ab4a836 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:56.264811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:56.265443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.265725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.266048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.267358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:56.269093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:56.279380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1053/2128] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:56.284318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.295662 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac211e-5bed-4bf7-9421-4b53072cd58d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:56.306049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:56.307195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.307695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.308637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] PATH_INFO: `/v3/projects/9077920093cb4ff3a6b7a3aea2e7cd29/users/9c9e8d7ae50941ba9e76138aaf604d41/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.311655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7593b2-1c07-41c1-9a9c-6e883f92e1bc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:56.315863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59442ec-3adf-44c8-9428-e8834102986a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:56.316536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59442ec-3adf-44c8-9428-e8834102986a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.316834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59442ec-3adf-44c8-9428-e8834102986a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.317150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59442ec-3adf-44c8-9428-e8834102986a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.326686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9077920093cb4ff3a6b7a3aea2e7cd29, user_id=9c9e8d7ae50941ba9e76138aaf604d41, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:56.327450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59442ec-3adf-44c8-9428-e8834102986a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:56.329903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59442ec-3adf-44c8-9428-e8834102986a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:56.331686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:56.345444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1076/2129] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:56.480005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1054/2130] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:56 2022] PUT /identity/v3/projects/9077920093cb4ff3a6b7a3aea2e7cd29/users/9c9e8d7ae50941ba9e76138aaf604d41/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:56.487706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.488166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.488608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.525922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:56.528324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.644598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1077/2131] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:56.704148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.707038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.866963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.870875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:56.887047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76bb3-5496-4585-9190-08792592ad61 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:56.897362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:56.899260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.899608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.902062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.927424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:56.932613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:56.944623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804061a-26ba-4ae0-92f2-c9be0814bd25 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:56.954498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:56.955551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:56.956048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:56.956534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] PATH_INFO: `/v3/projects/6b5248825d6d4748bb0fee41daea3606` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:56.957933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5248825d6d4748bb0fee41daea3606)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:56.963148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:56.963901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1055/2132] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:56.965425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:56.967833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.000341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027d5c-325e-4c73-86d3-cb913e7d2f0d service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:57.009660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:57.010705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.011150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.011616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] PATH_INFO: `/v3/users/284c7531c80a4b73af722318e124e00c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.013532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=284c7531c80a4b73af722318e124e00c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:57.019321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:57.121279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5248825d6d4748bb0fee41daea3606', 'request_id': 'req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.124739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5248825d6d4748bb0fee41daea3606', 'request_id': 'req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.238918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5248825d6d4748bb0fee41daea3606', 'request_id': 'req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.253312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] The token cache is being invalidate because project 6b5248825d6d4748bb0fee41daea3606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:57.253589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.254384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.256006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1078/2133] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:56 2022] DELETE /identity/v3/projects/6b5248825d6d4748bb0fee41daea3606 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:57.256896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:57.258429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.351786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceef7b4-cd6a-4451-96d1-4a5454fd9c07 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:57.353829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284c7531c80a4b73af722318e124e00c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.354722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284c7531c80a4b73af722318e124e00c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.359264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:57.360704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.361028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.361304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] PATH_INFO: `/v3/projects/59d66e45d06e406ea1ca9980b038e373` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.362594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d66e45d06e406ea1ca9980b038e373)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:57.364840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:57.388713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284c7531c80a4b73af722318e124e00c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.503563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284c7531c80a4b73af722318e124e00c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.504299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-83299257-8b6b-4e40-94a2-7a3fd8808edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284c7531c80a4b73af722318e124e00c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.521723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1056/2134] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:56 2022] DELETE /identity/v3/users/284c7531c80a4b73af722318e124e00c => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:57.523284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9da73-634b-41c5-b730-833cf6a7a68b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.523903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9da73-634b-41c5-b730-833cf6a7a68b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.524177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9da73-634b-41c5-b730-833cf6a7a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.532082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d66e45d06e406ea1ca9980b038e373', 'request_id': 'req-6b5d7c24-39c2-4996-b3ec-a257fe341c90'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.541274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d66e45d06e406ea1ca9980b038e373', 'request_id': 'req-6b5d7c24-39c2-4996-b3ec-a257fe341c90'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.546357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-07c9da73-634b-41c5-b730-833cf6a7a68b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:57.552287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-07c9da73-634b-41c5-b730-833cf6a7a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.661160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1057/2135] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:57.661160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.661160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.661160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.689804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d66e45d06e406ea1ca9980b038e373', 'request_id': 'req-6b5d7c24-39c2-4996-b3ec-a257fe341c90'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.708533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:57.710588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] The token cache is being invalidate because project 59d66e45d06e406ea1ca9980b038e373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:57.710720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.711108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.712264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6b5d7c24-39c2-4996-b3ec-a257fe341c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:57.716129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1079/2136] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:57 2022] DELETE /identity/v3/projects/59d66e45d06e406ea1ca9980b038e373 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:57.718397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.718954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.719308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.726572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1058/2137] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:57.728112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:57.730790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.759181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1f8ef-f3c0-44e3-bcb2-2115f82671b6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:57.761388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:57.763567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.767765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:57.768866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.769319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.769795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] PATH_INFO: `/v3/users/20cf14540f964f7aa2801bcb81864c74` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.771924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cf14540f964f7aa2801bcb81864c74)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:57.787536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:57.787692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1080/2138] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:57.787692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:57.787692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:57.863710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cba31-76cf-4b0a-aa14-1aeff3b9022e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:57.864823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:57.865261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.865465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.865902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.880089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:57.906385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:57.911844 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:57.928091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1081/2139] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:57.929023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:57.942139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e006e-e8e8-4d4c-8fa9-80bee491c0fd service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:57.954312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:57.955452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:57.955783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:57.956280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:57.957511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:57.957834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:57.959674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:57.979817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1082/2140] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:57.984451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:57.998381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eb749-b595-4ea7-b627-41d996714eda admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:58.004332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:58.004967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.005253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.005527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.006225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:58.008628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:58.069498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cf14540f964f7aa2801bcb81864c74'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:58.070701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cf14540f964f7aa2801bcb81864c74'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:58.086265 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cf14540f964f7aa2801bcb81864c74'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:58.135898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1083/2141] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:57 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:58.139872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:58.142685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:58.192611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cf14540f964f7aa2801bcb81864c74'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:58.195733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cf14540f964f7aa2801bcb81864c74'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:58.241512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d12deb-f9e5-42da-91aa-a1e0f90f2863 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:58.246761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:58.247465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.248386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.248912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.249700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1059/2142] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:57 2022] DELETE /identity/v3/users/20cf14540f964f7aa2801bcb81864c74 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:58.249834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:58.252643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:58.410347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1084/2143] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:58 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:58.411668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:58.560543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56b2ab-2f06-496b-a1d4-94ebfc84f7ce admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:58.587983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:58.589195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.589669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.591144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.594361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:58.613427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:58.633660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1060/2144] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:09:58.633943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:58.652235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8667bac-06b8-4796-b538-ddd82ca08414 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:58.658799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502f9dd-a574-4d8b-82ad-676c239b3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:58.659424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502f9dd-a574-4d8b-82ad-676c239b3729 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.659930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502f9dd-a574-4d8b-82ad-676c239b3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.660564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502f9dd-a574-4d8b-82ad-676c239b3729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.661239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502f9dd-a574-4d8b-82ad-676c239b3729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:58.663115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502f9dd-a574-4d8b-82ad-676c239b3729 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:58.679317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1085/2145] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:58.680857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:58.694359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2524b-b488-4b9b-a396-1f6b51b0cb50 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:58.704242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:58.704242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.704242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.704242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] PATH_INFO: `/v3/projects/c56e91a3e3934643812ba2f3397e66a9/users/dfeee47cb27c4ce19575126d155a6709/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.721332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56e91a3e3934643812ba2f3397e66a9, user_id=dfeee47cb27c4ce19575126d155a6709, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:58.724731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:58.856027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1061/2146] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:58 2022] PUT /identity/v3/projects/c56e91a3e3934643812ba2f3397e66a9/users/dfeee47cb27c4ce19575126d155a6709/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:58.874309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.874818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.879010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.927877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:58.931476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:58.951700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:58.975336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] MFA Rules not processed for user `dfeee47cb27c4ce19575126d155a6709`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:58.981225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:59.115465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68752780-f021-44ac-81b4-e2ff1251b6e6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:59.130797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:59.131864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:59.132203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:59.132531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] PATH_INFO: `/v3/projects/0c0f45d985e54adf94e6cd9cb0d7d126` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:59.134009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1086/2147] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:09:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:59.134202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0f45d985e54adf94e6cd9cb0d7d126)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:59.136453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:59.151588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:59.153555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:59.223804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5a7f-2b0e-4337-89ee-dde20ea47e60 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:59.228073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:59.228824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:59.229106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:59.229408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:59.240267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:59.241885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:59.252863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1087/2148] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:09:59.254097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:59.255553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:59.276831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4d81f-fdb5-4ed5-b9a4-493975a86be4 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:59.287445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:59.288563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:59.289111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:59.290416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] PATH_INFO: `/v3/projects/7e109a884b2249c886d98d9a6af8f43c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:59.304996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e109a884b2249c886d98d9a6af8f43c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:59.312542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:59.356581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0f45d985e54adf94e6cd9cb0d7d126', 'request_id': 'req-d7c286ea-0084-4cfc-978b-d26824a3f8ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.374412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0f45d985e54adf94e6cd9cb0d7d126', 'request_id': 'req-d7c286ea-0084-4cfc-978b-d26824a3f8ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.484464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0f45d985e54adf94e6cd9cb0d7d126', 'request_id': 'req-d7c286ea-0084-4cfc-978b-d26824a3f8ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.501191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] The token cache is being invalidate because project 0c0f45d985e54adf94e6cd9cb0d7d126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:59.501632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.502435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.505900 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1062/2149] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:58 2022] DELETE /identity/v3/projects/0c0f45d985e54adf94e6cd9cb0d7d126 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:59.508394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:59.511264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:59.548859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e109a884b2249c886d98d9a6af8f43c', 'request_id': 'req-04a748a8-298c-445f-b841-497e3d0b0a43'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.573553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e109a884b2249c886d98d9a6af8f43c', 'request_id': 'req-04a748a8-298c-445f-b841-497e3d0b0a43'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.629564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c286ea-0084-4cfc-978b-d26824a3f8ba admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:59.683502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e109a884b2249c886d98d9a6af8f43c', 'request_id': 'req-04a748a8-298c-445f-b841-497e3d0b0a43'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.707244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] The token cache is being invalidate because project 7e109a884b2249c886d98d9a6af8f43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:59.707244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.708119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:59.711975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1088/2150] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:59 2022] DELETE /identity/v3/projects/7e109a884b2249c886d98d9a6af8f43c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:59.717966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:59.719354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:59.744262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:59.745526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:59.747761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:59.748313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] PATH_INFO: `/v3/users/a64b583128a3420c9f235c7b73e4228f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:59.752795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64b583128a3420c9f235c7b73e4228f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:59.755050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:59.839805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a748a8-298c-445f-b841-497e3d0b0a43 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:59.846639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:59.847394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:59.848013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:59.848738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] PATH_INFO: `/v3/users/33515367b81c426ab19ef9690cdef002` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:59.867632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33515367b81c426ab19ef9690cdef002)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:59.871416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:00.005028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64b583128a3420c9f235c7b73e4228f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.007094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64b583128a3420c9f235c7b73e4228f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.049779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64b583128a3420c9f235c7b73e4228f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.174433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64b583128a3420c9f235c7b73e4228f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.175357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64b583128a3420c9f235c7b73e4228f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.195561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1063/2151] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:59 2022] DELETE /identity/v3/users/a64b583128a3420c9f235c7b73e4228f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:00.200955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:00.200955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:00.205239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33515367b81c426ab19ef9690cdef002'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.206244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33515367b81c426ab19ef9690cdef002'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.226767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33515367b81c426ab19ef9690cdef002'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.315692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33515367b81c426ab19ef9690cdef002'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.331358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:00.429718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973695e-9ec1-42b9-8aa9-8730a87b655d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:00.436441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:00.437366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:00.439419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:00.439419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] PATH_INFO: `/v3/users/7a70b009464f455dbad7e7954fa6374b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:00.440290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a70b009464f455dbad7e7954fa6374b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:00.443176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:00.501665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-91a59c29-b04d-4931-ab4f-038811cf9259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33515367b81c426ab19ef9690cdef002'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.517660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1089/2152] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:59 2022] DELETE /identity/v3/users/33515367b81c426ab19ef9690cdef002 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:00.707933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a70b009464f455dbad7e7954fa6374b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.708743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a70b009464f455dbad7e7954fa6374b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.766294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a70b009464f455dbad7e7954fa6374b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.886118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a70b009464f455dbad7e7954fa6374b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.887461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a70b009464f455dbad7e7954fa6374b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.907580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1064/2153] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:00 2022] DELETE /identity/v3/users/7a70b009464f455dbad7e7954fa6374b => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:00.909468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:00.910055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:00.910359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:00.952038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:00.954528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.077498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1090/2154] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:01.092700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.094206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.175555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231127-125e-4feb-98f0-747a7b4cca23 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.179374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:01.180154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.180432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.180751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.191903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:01.193385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.214830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1065/2155] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:01.347850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.351822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.367578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:01.500426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ff4d-00fb-4706-ba92-bda260da8266 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.536942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:01.537794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.538170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.538569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] PATH_INFO: `/v3/projects/1dd838fd28be49c995a8a0a2b64cb240` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.540067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd838fd28be49c995a8a0a2b64cb240)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:01.542087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.560974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.562684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.582255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a44a7-5c73-4b9f-8949-cd9fd2e9aa7a service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.591263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:01.592294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.592604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.593021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] PATH_INFO: `/v3/projects/77dc0a7b0897433797a853ceddadb8e9` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.594560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77dc0a7b0897433797a853ceddadb8e9)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:01.596752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.765293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77dc0a7b0897433797a853ceddadb8e9', 'request_id': 'req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.765498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd838fd28be49c995a8a0a2b64cb240', 'request_id': 'req-d6372f90-1b64-46ab-922d-b0b9d102547a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.781565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd838fd28be49c995a8a0a2b64cb240', 'request_id': 'req-d6372f90-1b64-46ab-922d-b0b9d102547a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.782863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77dc0a7b0897433797a853ceddadb8e9', 'request_id': 'req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.902075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77dc0a7b0897433797a853ceddadb8e9', 'request_id': 'req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.927522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] The token cache is being invalidate because project 77dc0a7b0897433797a853ceddadb8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:01.927831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.929766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-4f8f2cf6-ef97-4ff3-a8f8-b55198335095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.937358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1066/2156] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:01 2022] DELETE /identity/v3/projects/77dc0a7b0897433797a853ceddadb8e9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:01.939151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926357d-bdd4-490d-9129-66923e8bdca5 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.939648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926357d-bdd4-490d-9129-66923e8bdca5 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.940124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926357d-bdd4-490d-9129-66923e8bdca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.961259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd838fd28be49c995a8a0a2b64cb240', 'request_id': 'req-d6372f90-1b64-46ab-922d-b0b9d102547a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.969220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7926357d-bdd4-490d-9129-66923e8bdca5 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:01.971623 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7926357d-bdd4-490d-9129-66923e8bdca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.996048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] The token cache is being invalidate because project 1dd838fd28be49c995a8a0a2b64cb240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:01.996494 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.997508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d6372f90-1b64-46ab-922d-b0b9d102547a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.004999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1091/2157] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:01 2022] DELETE /identity/v3/projects/1dd838fd28be49c995a8a0a2b64cb240 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:02.006838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dafa3a-d204-4a6a-929c-0bd19dbd259a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.007597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dafa3a-d204-4a6a-929c-0bd19dbd259a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.008069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dafa3a-d204-4a6a-929c-0bd19dbd259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.054872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-86dafa3a-d204-4a6a-929c-0bd19dbd259a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:02.054872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-86dafa3a-d204-4a6a-929c-0bd19dbd259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.127226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1067/2158] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:02.128955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.129248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.129521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.171674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:02.174369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.180976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1092/2159] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:02.184291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.184581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.185061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.205229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1068/2160] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:02.209673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.211563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:02.213754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.242473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1093/2161] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:02.242768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf4286-2ab2-4c38-9b8e-5360b5a6c910 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.242768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.242768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.242768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.243031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.243313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:02.243410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.243558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.245314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.257466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee78683-c50f-4ffa-9603-3594b18c4fac None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.263270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1069/2162] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:10:02.264467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.267748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.268570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.269128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.269616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.272187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:02.272886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.278258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550d39-6aac-4eea-9ac2-b471ce742beb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.278927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.283449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.284235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.284523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.284804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.285474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.287753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.318649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1094/2163] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:10:02.318649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.333518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb589038-1324-487b-b974-02bfb6e28835 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.340371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.340964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.341245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.341516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.342191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.344351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.512912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1095/2164] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:02.529191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1070/2165] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:02.529766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.531585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.540917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.773838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcda14-eefc-4e30-8b32-0a7400c968de admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.853084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24425148-73e8-477c-8840-35ddb189d813 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.856533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:02.877384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.878537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.879031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.879503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.880695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.898274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.951635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.952641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.953021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.953399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] PATH_INFO: `/v3/projects/5480039b94624998b753a2b405c90eec` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.955544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5480039b94624998b753a2b405c90eec)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.961358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.170762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1071/2166] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/users => generated 292 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:03.178531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.200473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b100610-6902-44a3-9a7f-9514b2806e2b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.208048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.210488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.210488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.210488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.211695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.214076 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.286247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5480039b94624998b753a2b405c90eec', 'request_id': 'req-885968b8-ac3f-40c5-8298-3ec7088a022e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:03.299469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5480039b94624998b753a2b405c90eec', 'request_id': 'req-885968b8-ac3f-40c5-8298-3ec7088a022e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:03.342892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1072/2167] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:03 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:03.343920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.374387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ff3e-96cc-4ae5-b9bc-8efc0535b3a4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.429461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5480039b94624998b753a2b405c90eec', 'request_id': 'req-885968b8-ac3f-40c5-8298-3ec7088a022e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:03.460401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] The token cache is being invalidate because project 5480039b94624998b753a2b405c90eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:03.460906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:03.465002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:03.473540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1096/2168] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:02 2022] DELETE /identity/v3/projects/5480039b94624998b753a2b405c90eec => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:03.480160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.485253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:03.557264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:03.561332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.562517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.562961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.569199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.570650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.575764 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.592903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885968b8-ac3f-40c5-8298-3ec7088a022e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.599926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.600963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.601449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.601961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.603134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.605203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.610697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1073/2169] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:03.610697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.612664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:03.621770 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1097/2170] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:03.626953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.629811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:03.649351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001250b-ca76-40e9-a4e3-153a85421620 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.657888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.658948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.659599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.660070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] PATH_INFO: `/v3/users/a1ce1291cbcc43219850a54d91b579af` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.662261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ce1291cbcc43219850a54d91b579af)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.666184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.677201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd31f-bc73-413f-91d9-26a828c97b42 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.697298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.698381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.698881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.699376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.700550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.708050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.754279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1098/2171] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:03.754279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.775352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560d61-31c6-45e8-85bc-fe5c9ebeaa43 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.782457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.783442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.785109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.785881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.786629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.787982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.805438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1099/2172] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:03.806529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.818899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95c108-b43c-4b88-a6bf-2190ee65034c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.827177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.828297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.828578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.829686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] PATH_INFO: `/v3/projects/7d9281ee0665459dae69dfa80d23bb15/users/d452e82ec89e447db772b6732e963ae8/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.862408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9281ee0665459dae69dfa80d23bb15, user_id=d452e82ec89e447db772b6732e963ae8, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.865588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:04.286976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1100/2173] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:03 2022] PUT /identity/v3/projects/7d9281ee0665459dae69dfa80d23bb15/users/d452e82ec89e447db772b6732e963ae8/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:04.286976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:04.358245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ce1291cbcc43219850a54d91b579af'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:04.361631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ce1291cbcc43219850a54d91b579af'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:04.395772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ce1291cbcc43219850a54d91b579af'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:04.439941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966f6c2-ba6d-4181-a24d-a72160f47b70 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:04.446686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:04.447619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:04.447727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:04.447949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] PATH_INFO: `/v3/projects/e7742c1e5d9145ddab8f41d4eccb25f2/users/59dcaf2559af4049979b151e275ea26e/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:04.475555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7742c1e5d9145ddab8f41d4eccb25f2, user_id=59dcaf2559af4049979b151e275ea26e, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:04.480126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:04.500408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ce1291cbcc43219850a54d91b579af'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:04.502218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2c395f00-0eae-4837-9c4f-61871927796b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ce1291cbcc43219850a54d91b579af'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:04.519624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1074/2174] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:03 2022] DELETE /identity/v3/users/a1ce1291cbcc43219850a54d91b579af => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:04.521492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8668-41d8-4532-a289-a7937f018ab4 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:04.521974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8668-41d8-4532-a289-a7937f018ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:04.523110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8668-41d8-4532-a289-a7937f018ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:04.546799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b74e8668-41d8-4532-a289-a7937f018ab4 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:04.549234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b74e8668-41d8-4532-a289-a7937f018ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:04.606408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1101/2175] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:04 2022] PUT /identity/v3/projects/e7742c1e5d9145ddab8f41d4eccb25f2/users/59dcaf2559af4049979b151e275ea26e/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:04.606408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:04.613668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:04.627540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=15,keystone:SELECT=80,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:04.653021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1075/2176] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:04.655879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:04.656149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:04.656498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:04.716726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:04.716726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:04.794451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1076/2177] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:04.795432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:04.797279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:04.804092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bffe9-c28d-455b-aadb-a76ec5cff013 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:04.820708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:04.821315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:04.825824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:04.831463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] PATH_INFO: `/v3/users/dfeee47cb27c4ce19575126d155a6709` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:04.831810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfeee47cb27c4ce19575126d155a6709)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:04.834515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:04.898842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf376ab3-dbd2-4948-a230-141c9a333908 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:04.904203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:04.905112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:04.905112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:04.905405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:04.916465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:04.918021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:04.941954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1077/2178] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:04.947604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:04.949812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:04.977732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a797b-cd5c-4de0-87d4-ec95e78a5ffb service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:04.985456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f5f26-9b4b-4d2f-b69d-d4428451293e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:04.986455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f5f26-9b4b-4d2f-b69d-d4428451293e service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:04.986822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f5f26-9b4b-4d2f-b69d-d4428451293e service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:04.987152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f5f26-9b4b-4d2f-b69d-d4428451293e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:04.998295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f5f26-9b4b-4d2f-b69d-d4428451293e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:05.000326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f5f26-9b4b-4d2f-b69d-d4428451293e service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:05.010783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1078/2179] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:05.169941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfeee47cb27c4ce19575126d155a6709'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.172896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfeee47cb27c4ce19575126d155a6709'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.183357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfeee47cb27c4ce19575126d155a6709'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.216011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfeee47cb27c4ce19575126d155a6709'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.347704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfeee47cb27c4ce19575126d155a6709'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.356234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1102/2180] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:04 2022] DELETE /identity/v3/users/dfeee47cb27c4ce19575126d155a6709 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:05.361678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:05.362309 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:05.362494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:05.384811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:05.386306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:05.457148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:05.467631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:05.489904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1079/2181] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:05.496951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308c167-06eb-4ec7-b71e-1574b555a768 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:05.506808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:05.507894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:05.508265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:05.508835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] PATH_INFO: `/v3/projects/d5e38a177ded42ffaf4f659911ddda8e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:05.510866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:05.513465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:05.529756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e38a177ded42ffaf4f659911ddda8e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:05.533606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:05.623683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b391f-ebf8-4731-b750-3c52721d61d3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:05.631849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400807-3640-4ef6-aaea-687b6c6a0fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:05.633151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400807-3640-4ef6-aaea-687b6c6a0fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:05.634196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400807-3640-4ef6-aaea-687b6c6a0fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:05.634196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400807-3640-4ef6-aaea-687b6c6a0fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:05.656255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e400807-3640-4ef6-aaea-687b6c6a0fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:05.658573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e400807-3640-4ef6-aaea-687b6c6a0fb0 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:05.681313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1080/2182] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:05.710911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e38a177ded42ffaf4f659911ddda8e', 'request_id': 'req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.725565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e38a177ded42ffaf4f659911ddda8e', 'request_id': 'req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.885244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e38a177ded42ffaf4f659911ddda8e', 'request_id': 'req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.906897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] The token cache is being invalidate because project d5e38a177ded42ffaf4f659911ddda8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:05.907238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.909396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a67b22d8-d04e-48d9-bd4d-f77f2541ee57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:05.912568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1103/2183] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:05 2022] DELETE /identity/v3/projects/d5e38a177ded42ffaf4f659911ddda8e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:05.922028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:05.922028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:05.922028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:05.964862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:05.973568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:06.188579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1081/2184] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:06.199144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:06.199923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:06.200461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:06.243735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:06.277974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:06.280525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:06.324695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1104/2185] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:06.325495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:06.340867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db411e-3ada-4774-b1d6-37805c108760 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:06.352747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:06.353393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:06.353672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:06.353966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:06.357538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:06.360660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:06.363348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:06.405058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:06.417601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1082/2186] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:10:06.428945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f7019-d4c8-4720-9b86-2e5002e48e3e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:06.442260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ef0b0-e16a-4732-ab08-2b01eb124695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:06.442260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ef0b0-e16a-4732-ab08-2b01eb124695 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:06.442260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ef0b0-e16a-4732-ab08-2b01eb124695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:06.443538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ef0b0-e16a-4732-ab08-2b01eb124695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:06.445050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ef0b0-e16a-4732-ab08-2b01eb124695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:06.450223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ef0b0-e16a-4732-ab08-2b01eb124695 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:06.602418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1105/2187] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:06.606258 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:06.633322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287373-cc24-4f02-880f-8afa349e24ce admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:06.700427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:06.706253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:06.706951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:06.788464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] MFA Rules not processed for user `9c9e8d7ae50941ba9e76138aaf604d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:06.790929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:06.803841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:06.804877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:06.805227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:06.805654 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:06.806878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:06.810542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:06.917934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1106/2188] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:06.959418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:06.963946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:06.983188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1083/2189] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:06 2022] POST /identity/v3/users => generated 289 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:06.984578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:06.988919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:07.010430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0578305-7d65-4e0e-9fa9-bda1ad6a4ecb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:07.016760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:07.017902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.018674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.027984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] PATH_INFO: `/v3/projects/c56e91a3e3934643812ba2f3397e66a9` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.030002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56e91a3e3934643812ba2f3397e66a9)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:07.033267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:07.116341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:07.196391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56e91a3e3934643812ba2f3397e66a9', 'request_id': 'req-9f4acbc1-9aa0-4175-9275-fadefdba6728'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:07.201517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29bc68-9388-4202-b81a-296ac034ccf1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:07.206689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56e91a3e3934643812ba2f3397e66a9', 'request_id': 'req-9f4acbc1-9aa0-4175-9275-fadefdba6728'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:07.339220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56e91a3e3934643812ba2f3397e66a9', 'request_id': 'req-9f4acbc1-9aa0-4175-9275-fadefdba6728'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:07.364964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] The token cache is being invalidate because project c56e91a3e3934643812ba2f3397e66a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:07.367906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:07.369634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:07.381038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1084/2190] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:06 2022] DELETE /identity/v3/projects/c56e91a3e3934643812ba2f3397e66a9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:07.383413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:07.386565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:07.395137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:07.395961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.396601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.396846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.399252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:07.618925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4acbc1-9aa0-4175-9275-fadefdba6728 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:07.620407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:07.622443 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c1d11-093b-4afa-a90b-7dde09c2c5ac service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:07.640523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:07.641619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.642194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.642700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.643937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:07.650980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:07.651547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1107/2191] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:07.653130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b290-fc5a-42db-88ff-0659bc8323ce None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.655451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b290-fc5a-42db-88ff-0659bc8323ce None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.657597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b290-fc5a-42db-88ff-0659bc8323ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.691371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1085/2192] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:07.705291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:07.717234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-50b2b290-fc5a-42db-88ff-0659bc8323ce None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:07.720929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50b2b290-fc5a-42db-88ff-0659bc8323ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:07.740347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1108/2193] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:07.764817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.766703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.766703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.777777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8875-6b5b-4a4e-8fb7-2371215ee86a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:07.805521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98017d8b-cfb3-4a82-ac98-a81a94036bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:07.806838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98017d8b-cfb3-4a82-ac98-a81a94036bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.807582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98017d8b-cfb3-4a82-ac98-a81a94036bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.808115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98017d8b-cfb3-4a82-ac98-a81a94036bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.809217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98017d8b-cfb3-4a82-ac98-a81a94036bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:07.811888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98017d8b-cfb3-4a82-ac98-a81a94036bcb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:07.820008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:07.824752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:07.840875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1086/2194] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:07.842398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.843682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.843682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.850233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1109/2195] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:07.853989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:07.877251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb918d-1ab9-4c03-a7ec-28d49d4272d0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:07.888320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] MFA Rules not processed for user `59dcaf2559af4049979b151e275ea26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:07.889894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:07.890550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:07.891674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.892067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.892437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] PATH_INFO: `/v3/projects/47b8aa2f8b5d4dc59a914a99d054b15a/users/d0e991e489334961a18a96d1a3602d15/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.968711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b8aa2f8b5d4dc59a914a99d054b15a, user_id=d0e991e489334961a18a96d1a3602d15, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:07.978520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.042030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1087/2196] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:08.043452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.061081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a3c23-4b12-44d9-a2ef-bc116f4bd3ae None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.072000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.072841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.074897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.075417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.076315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:08.076772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.089584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.121052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1088/2197] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:10:08.123962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.133438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1110/2198] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:07 2022] PUT /identity/v3/projects/47b8aa2f8b5d4dc59a914a99d054b15a/users/d0e991e489334961a18a96d1a3602d15/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:08.133438 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.136847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:08.178052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17f454-0117-453d-8710-b07496efb2d9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.345629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cdb6e-7086-4f2c-b21f-eff78743beaa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.357657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44590-4e2c-4ab1-9669-00c527a31814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.358351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44590-4e2c-4ab1-9669-00c527a31814 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.358636 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44590-4e2c-4ab1-9669-00c527a31814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.358912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44590-4e2c-4ab1-9669-00c527a31814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.359573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e44590-4e2c-4ab1-9669-00c527a31814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.362195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e44590-4e2c-4ab1-9669-00c527a31814 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.384757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.385616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.385775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.385950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.386615 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.391149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.499023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1111/2199] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/projects => generated 373 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:08.502871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.505947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.507484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.519828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1089/2200] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/projects => generated 373 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:08.520791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.598003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] MFA Rules not processed for user `d0e991e489334961a18a96d1a3602d15`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:08.599819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:08.610909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754527-b63f-4029-bf44-aa5d651aff99 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.631322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.632532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.633036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.633525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.634818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.640085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.661813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:08.741800 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1112/2201] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:08.742814 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.755454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfe021-c47a-4ec8-b2fe-2016d9e28c0f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.764670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.766828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.767479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.767769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.768445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.771972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.870518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1090/2202] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/users => generated 287 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:08.872827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.928947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139f724-1efa-4de9-89b7-f7b41cfaa76c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.946385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1113/2203] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:08.950976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.973448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.975252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f91100-b62c-4f10-aa67-98a2c27e622e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.976901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.979450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.984269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.984269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.993794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.994488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.994775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.995056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.995804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.996787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.997467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.029686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1114/2204] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:09.029686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.049609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe69df-5f8c-46f6-860b-aee78e708af3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.085672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.087236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.093202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.097755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.099699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.105344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.161380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1115/2205] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:09.164967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.206056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac83d3-2d0e-4a5d-b730-ecf47980378d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.241271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.241561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1091/2206] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/projects => generated 373 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:09.244167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.245473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.246315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.247897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.250084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.255621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.322583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:09.370034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1116/2207] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:09.378518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.440633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77db4db-69dd-4ede-b390-9f493e69a31e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.574474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b306-5a6a-4a85-9f4f-0a5c7153f76b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.586797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.589455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.589455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.589455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] PATH_INFO: `/v3/projects/bc42957a9137436cbfc2de58adffe8f7/users/dcb14b32b38b414796bdc62838205f67/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.619917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.620563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.620896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.621179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.621870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.623847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc42957a9137436cbfc2de58adffe8f7, user_id=dcb14b32b38b414796bdc62838205f67, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.628081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.631041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.742105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1092/2208] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:09 2022] PUT /identity/v3/projects/bc42957a9137436cbfc2de58adffe8f7/users/dcb14b32b38b414796bdc62838205f67/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:09.744931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.765919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1117/2209] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/users => generated 293 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:09.766191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.809087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c78ce-f08a-42c9-a797-96e5b4847814 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.878479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c91c-27b0-40a8-912d-e992ea81d932 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.893782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.893782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.893782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.895244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] PATH_INFO: `/v3/projects/7113166016704f999cce7f533a8299ac/users/2e56b9ff50c7434fbd7745a950628f77/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.936969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7113166016704f999cce7f533a8299ac, user_id=2e56b9ff50c7434fbd7745a950628f77, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.940410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.948829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.949733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.949929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.950376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.951162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.954316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.970357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1118/2210] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:09.971037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.990898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27eb49-24bf-4eba-b203-0bfaa4cbaf80 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.998701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.999351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.999674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.000006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.001472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.003456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.020898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1119/2211] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:10.022262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.035506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31233b-5fab-403f-9315-ac4d7134175d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.042440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3395b-5584-42c4-a017-02ba3dea2cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.046411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1093/2212] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:09 2022] PUT /identity/v3/projects/7113166016704f999cce7f533a8299ac/users/2e56b9ff50c7434fbd7745a950628f77/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:10.048042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.059011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3395b-5584-42c4-a017-02ba3dea2cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.059335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3395b-5584-42c4-a017-02ba3dea2cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.063164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3395b-5584-42c4-a017-02ba3dea2cac admin admin] PATH_INFO: `/v3/projects/bc42957a9137436cbfc2de58adffe8f7/users/dcb14b32b38b414796bdc62838205f67/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.065512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3395b-5584-42c4-a017-02ba3dea2cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc42957a9137436cbfc2de58adffe8f7, user_id=dcb14b32b38b414796bdc62838205f67, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.072045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3395b-5584-42c4-a017-02ba3dea2cac admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.109397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1120/2213] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:10 2022] PUT /identity/v3/projects/bc42957a9137436cbfc2de58adffe8f7/users/dcb14b32b38b414796bdc62838205f67/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:10.113133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.113487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.116063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.169760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:10.171337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:10.222325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18de8ac-6be4-409f-acef-ace1d4077aed admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.256144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:10.261425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1121/2214] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:10.370535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.373318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:10.399493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.400700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.400700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.400914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] PATH_INFO: `/v3/projects/aeeea4acdd6d4dc98e0d67e6e91c8829/users/bc56ef1db4fb4d708346ec92d3875382/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.444167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeeea4acdd6d4dc98e0d67e6e91c8829, user_id=bc56ef1db4fb4d708346ec92d3875382, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.452375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.546947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c7dc9-07b6-4803-b2c4-78973fd9b45f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.553174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.553919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.554215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.554564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.569749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.570969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.584633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1122/2215] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:10.604280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1094/2216] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:10 2022] PUT /identity/v3/projects/aeeea4acdd6d4dc98e0d67e6e91c8829/users/bc56ef1db4fb4d708346ec92d3875382/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:10.623298 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.646378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765e44-68dc-452a-9a77-c39ec026f93d service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.770389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b839b-accb-4236-a957-bcc0e969c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.771984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b839b-accb-4236-a957-bcc0e969c5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.772525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b839b-accb-4236-a957-bcc0e969c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.773099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b839b-accb-4236-a957-bcc0e969c5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.774006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b839b-accb-4236-a957-bcc0e969c5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.775872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b839b-accb-4236-a957-bcc0e969c5cb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.798714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1123/2217] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:10:10.802716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.820890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd46ec-b47d-4005-99d9-47eaa8ddc4d0 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.834144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.834895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.835714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.836079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] PATH_INFO: `/v3/projects/aeeea4acdd6d4dc98e0d67e6e91c8829/users/bc56ef1db4fb4d708346ec92d3875382/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.838608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeeea4acdd6d4dc98e0d67e6e91c8829, user_id=bc56ef1db4fb4d708346ec92d3875382, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.841420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.874089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1095/2218] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:10 2022] PUT /identity/v3/projects/aeeea4acdd6d4dc98e0d67e6e91c8829/users/bc56ef1db4fb4d708346ec92d3875382/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:10.884194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81e082-e78e-4150-8517-873778d28d70 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.884627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81e082-e78e-4150-8517-873778d28d70 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.885008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81e082-e78e-4150-8517-873778d28d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.947440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-da81e082-e78e-4150-8517-873778d28d70 None None] MFA Rules not processed for user `bc56ef1db4fb4d708346ec92d3875382`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:10.950195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da81e082-e78e-4150-8517-873778d28d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:11.192628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1124/2219] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:11.222510 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.226836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:11.423570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45956439-ba14-4071-a06c-895b7b7750e7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.440598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5ee3-e961-421a-b064-288e6b9c1946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.441656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5ee3-e961-421a-b064-288e6b9c1946 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.441656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5ee3-e961-421a-b064-288e6b9c1946 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.441895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5ee3-e961-421a-b064-288e6b9c1946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.535163 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce5ee3-e961-421a-b064-288e6b9c1946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.538857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce5ee3-e961-421a-b064-288e6b9c1946 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.558754 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1096/2220] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:11.872778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:13.012243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:13.832342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.833150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.833625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.956456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] MFA Rules not processed for user `dcb14b32b38b414796bdc62838205f67`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:13.966557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615d22-bafc-43db-9a8f-0c91a30a2aad None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.966557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615d22-bafc-43db-9a8f-0c91a30a2aad None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.966557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615d22-bafc-43db-9a8f-0c91a30a2aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.967066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.016139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fe615d22-bafc-43db-9a8f-0c91a30a2aad None None] MFA Rules not processed for user `9c9e8d7ae50941ba9e76138aaf604d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:14.022024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fe615d22-bafc-43db-9a8f-0c91a30a2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.139802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1097/2221] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:14.171532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1125/2222] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:14.191700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:14.191937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:14.192220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:14.224915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] MFA Rules not processed for user `59dcaf2559af4049979b151e275ea26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:14.226914 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.350171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1098/2223] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:14.473114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:14.601709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:14.606050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.750867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217dcd8-0892-4649-b071-04dd3cd30207 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:14.762856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65550-3bf0-4c43-bb53-a5190eb1a4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:14.763665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65550-3bf0-4c43-bb53-a5190eb1a4f7 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:14.764076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65550-3bf0-4c43-bb53-a5190eb1a4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:14.764376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65550-3bf0-4c43-bb53-a5190eb1a4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:14.778297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65550-3bf0-4c43-bb53-a5190eb1a4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:14.780836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65550-3bf0-4c43-bb53-a5190eb1a4f7 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:14.797717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1126/2224] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:15.638490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:17.324917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:17.736985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:18.112746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:18.149384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fad55-bae7-4fec-a141-b95ae5d71cff None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:18.170931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:18.173650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:18.175622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:18.176384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:18.210250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:18.211775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:18.242179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1099/2225] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:20.860078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:20.860689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:20.861189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:20.911765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] MFA Rules not processed for user `d452e82ec89e447db772b6732e963ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:20.913828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:21.099180 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1127/2226] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:21.104394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:21.108083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:21.337046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:21.397743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eae00c-c16b-491b-9b9b-199f2a2819cc service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:21.412360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:21.413908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:21.420000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:21.424993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:21.424993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:21.426466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:21.606260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1100/2227] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:21 2022] POST /identity/v3/projects => generated 383 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:21.612079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:21.665837 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c508de-3291-43b3-bc56-c990c880a998 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:21.692483 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:21.952414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:21.953053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:21.953390 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:21.953667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:21.954372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:21.957197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:22.085660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1128/2228] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:21 2022] POST /identity/v3/users => generated 298 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:22.090500 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:22.112769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbcf4f-5083-4d4b-b45f-a3b8a8edf677 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:22.126357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:22.127219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:22.127667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:22.128093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:22.129135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:22.132028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:22.157564 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1101/2229] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:22.159635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:22.193555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5631e-1198-42f3-9cb5-30850bf048d2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:22.214402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8200d4-8d83-48ba-b949-a9f37547665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:22.218000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8200d4-8d83-48ba-b949-a9f37547665a admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:22.218297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8200d4-8d83-48ba-b949-a9f37547665a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:22.220190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8200d4-8d83-48ba-b949-a9f37547665a admin admin] PATH_INFO: `/v3/projects/4d0d6f148a63413d95c15c522c942308/users/44090bd6173c4677b1d4e7a836c0aae1/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:22.269836 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8200d4-8d83-48ba-b949-a9f37547665a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d6f148a63413d95c15c522c942308, user_id=44090bd6173c4677b1d4e7a836c0aae1, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:22.272808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8200d4-8d83-48ba-b949-a9f37547665a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:22.458400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1129/2230] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:22 2022] PUT /identity/v3/projects/4d0d6f148a63413d95c15c522c942308/users/44090bd6173c4677b1d4e7a836c0aae1/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:22.464170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:22.499505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9f22-0468-4db6-bf66-3d4c3b4f2397 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:22.640200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:22.640750 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:22.641232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:22.731471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:22.732108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:22.732395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:22.732679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:22.733681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:22.735802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:22.750496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] MFA Rules not processed for user `2e56b9ff50c7434fbd7745a950628f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:22.753951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:22.775382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1102/2231] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:22.782642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:22.800793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4284-d24d-4df9-820f-afb2e4f8c9bb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:22.807339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:22.812143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:22.812143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:22.812143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] PATH_INFO: `/v3/projects/4d0d6f148a63413d95c15c522c942308/users/44090bd6173c4677b1d4e7a836c0aae1/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:22.813794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d6f148a63413d95c15c522c942308, user_id=44090bd6173c4677b1d4e7a836c0aae1, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:22.819655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:22.848812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1103/2232] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:22 2022] PUT /identity/v3/projects/4d0d6f148a63413d95c15c522c942308/users/44090bd6173c4677b1d4e7a836c0aae1/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:22.999722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1130/2233] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:23.006812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:23.259820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03656d7-124b-46e7-a948-3468f0cf3fa7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:23.268479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:23.269259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:23.269546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:23.269822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:23.270534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:23.272597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:23.528300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1104/2234] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:23 2022] POST /identity/v3/projects => generated 371 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:23.528564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:23.557045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca8562-9c4d-411c-9c30-41d0d93f2365 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:23.727607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:23.729321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:23.729321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:23.729321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:23.729560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:23.743854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:23.753141 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:23.929935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1131/2235] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:23 2022] POST /identity/v3/users => generated 292 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:23.934254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:23.953012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e49f31-6c60-4095-92ca-33517953c8a1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:23.969208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:23.969894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:23.970161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:23.970461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:23.971176 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:23.975679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:24.016450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1105/2236] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:10:24.022838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:24.043697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ced72-3c95-43b9-b890-d11c99710ac0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:24.057176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:24.058145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:24.060588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:24.061243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] PATH_INFO: `/v3/projects/e115705bd18d483ab27f43814e27a076/users/3fb9e943c8184ae59d654ea55cfb59ad/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:24.101302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e115705bd18d483ab27f43814e27a076, user_id=3fb9e943c8184ae59d654ea55cfb59ad, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:24.108697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:24.279296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1132/2237] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:24 2022] PUT /identity/v3/projects/e115705bd18d483ab27f43814e27a076/users/3fb9e943c8184ae59d654ea55cfb59ad/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:24.281113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:24.307055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18923ec-69a0-4707-aea7-092129cac0ec admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:24.437214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee76631-917a-44cb-9b66-cece0f09a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:24.438729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee76631-917a-44cb-9b66-cece0f09a986 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:24.439213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee76631-917a-44cb-9b66-cece0f09a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:24.440104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee76631-917a-44cb-9b66-cece0f09a986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:24.441092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee76631-917a-44cb-9b66-cece0f09a986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:24.443145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee76631-917a-44cb-9b66-cece0f09a986 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:24.480791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1106/2238] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:24.486781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:24.535061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424564a-9c54-4ed4-aa64-a746071f34b2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:24.555307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:24.556018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:24.556322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:24.556600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] PATH_INFO: `/v3/projects/e115705bd18d483ab27f43814e27a076/users/3fb9e943c8184ae59d654ea55cfb59ad/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:24.569957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e115705bd18d483ab27f43814e27a076, user_id=3fb9e943c8184ae59d654ea55cfb59ad, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:24.578403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:24.625760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1133/2239] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:24 2022] PUT /identity/v3/projects/e115705bd18d483ab27f43814e27a076/users/3fb9e943c8184ae59d654ea55cfb59ad/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:24.994995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:26.727064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:26.770522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:29.215769 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:29.381474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f09253-f064-4b23-bf11-b6e44ca45fc6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:29.382256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f09253-f064-4b23-bf11-b6e44ca45fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:29.382256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f09253-f064-4b23-bf11-b6e44ca45fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:29.432233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-78f09253-f064-4b23-bf11-b6e44ca45fc6 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:29.433733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-78f09253-f064-4b23-bf11-b6e44ca45fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:29.589505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1107/2240] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:29.680934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:29.680934 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:29.877912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c9986-e5c5-4e05-a739-416d5670b724 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:29.892810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:29.894703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:29.894990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:29.895273 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:29.921007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:29.923289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:29.949375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1134/2241] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:10:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:10:31.283563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:32.024083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225499ae-065b-4d31-a502-825b8df7d269 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:32.024632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225499ae-065b-4d31-a502-825b8df7d269 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:32.025031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225499ae-065b-4d31-a502-825b8df7d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:32.056721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-225499ae-065b-4d31-a502-825b8df7d269 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:32.058452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-225499ae-065b-4d31-a502-825b8df7d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:32.099640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1108/2242] 10.222.0.47 () {58 vars in 967 bytes} [Mon Oct 10 12:10:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:32.123839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:32.139939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82b3a-097d-4ccd-8b9a-e0cb8f848f4c service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:32.151892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:32.152943 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:32.153702 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:32.154341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:32.167573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:32.169910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:32.247796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1135/2243] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:10:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:10:33.078950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:33.289606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e7101-d722-4c08-9526-6e4c2f01af2c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:33.290620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e7101-d722-4c08-9526-6e4c2f01af2c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:33.291047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e7101-d722-4c08-9526-6e4c2f01af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:33.329009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bc2e7101-d722-4c08-9526-6e4c2f01af2c None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:33.330292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bc2e7101-d722-4c08-9526-6e4c2f01af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:33.357253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:33.366909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1109/2244] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:10:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:33.382603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325c5bb-a3dc-4428-b5bb-97264821be11 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:33.396079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:33.396983 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:33.397621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:33.400945 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:33.418062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:33.423876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:33.448808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1136/2245] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:10:34.370343 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:34.552862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95be50-9eca-4801-aeaf-c8fb6807dfef None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:34.552862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95be50-9eca-4801-aeaf-c8fb6807dfef None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:34.553180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95be50-9eca-4801-aeaf-c8fb6807dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:34.615160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ce95be50-9eca-4801-aeaf-c8fb6807dfef None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:34.616644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ce95be50-9eca-4801-aeaf-c8fb6807dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:34.635534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1110/2246] 10.222.0.47 () {58 vars in 967 bytes} [Mon Oct 10 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:34.655092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:34.670385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed9ae0-d7ef-402c-a163-d6abb45ca7ee service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:34.684085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:34.685008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:34.686420 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:34.688077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:34.710819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:34.715689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:34.746528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1137/2247] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:10:36.019909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:37.187707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:38.112267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c54d6-8847-408a-be74-026322fe1df1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:38.112578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c54d6-8847-408a-be74-026322fe1df1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:38.112835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c54d6-8847-408a-be74-026322fe1df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:38.198845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-919c54d6-8847-408a-be74-026322fe1df1 None None] MFA Rules not processed for user `44090bd6173c4677b1d4e7a836c0aae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:38.200069 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-919c54d6-8847-408a-be74-026322fe1df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:38.255768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:38.439077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1111/2248] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:38.454968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:38.457711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:38.532747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:38.533427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:38.533808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:38.589905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] MFA Rules not processed for user `3fb9e943c8184ae59d654ea55cfb59ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:38.592583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:38.623178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa9987-56a4-406c-8ea6-3788b1c10e81 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:38.635145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13ee6f-da6e-416f-b9a9-56420d489ccd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:38.635145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ee6f-da6e-416f-b9a9-56420d489ccd service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:38.635145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ee6f-da6e-416f-b9a9-56420d489ccd service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:38.637913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13ee6f-da6e-416f-b9a9-56420d489ccd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:38.786413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1112/2249] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:38.802147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:38.838561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13ee6f-da6e-416f-b9a9-56420d489ccd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:38.840781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13ee6f-da6e-416f-b9a9-56420d489ccd service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:38.855228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1138/2250] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:38.971836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddc993-fa3a-4953-9ee9-d84659508d80 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:38.982788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:38.982788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:38.983168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:38.983455 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:39.080534 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:39.083588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:39.107323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1113/2251] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:39.257010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:39.257662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:39.257662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:39.287919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:39.289167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:39.289557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:39.290553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:39.303700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1139/2252] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:39.324330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:39.337139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22847c46-1262-4b21-83f8-d76ad9f977cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:39.342955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160cf04-f0f4-46e5-a216-a0318b21984b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:39.344233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cf04-f0f4-46e5-a216-a0318b21984b service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:39.344639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cf04-f0f4-46e5-a216-a0318b21984b service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:39.345437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cf04-f0f4-46e5-a216-a0318b21984b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:39.355641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cf04-f0f4-46e5-a216-a0318b21984b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:39.357406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cf04-f0f4-46e5-a216-a0318b21984b service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:39.366748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1140/2253] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:10:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 12:10:39.382203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a15fa-10eb-4bcd-9a63-a5ab30b88c05 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:39.387005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:39.387819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:39.388166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:39.388508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] PATH_INFO: `/v3/users/960e90a7bcef42ffb2712cb3a97929fb` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:39.389745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=960e90a7bcef42ffb2712cb3a97929fb)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:39.392393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:39.655085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960e90a7bcef42ffb2712cb3a97929fb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:39.665537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960e90a7bcef42ffb2712cb3a97929fb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:39.717469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960e90a7bcef42ffb2712cb3a97929fb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:39.792580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960e90a7bcef42ffb2712cb3a97929fb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:39.793473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960e90a7bcef42ffb2712cb3a97929fb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:39.823908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1114/2254] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:39 2022] DELETE /identity/v3/users/960e90a7bcef42ffb2712cb3a97929fb => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:39.829893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:39.830586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:39.831134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:39.860244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:39.862242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:39.994354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1141/2255] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:40.008416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:40.010267 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:40.130735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:40.223860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7da73-620d-439e-b087-4135a66c0783 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:40.230502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6539-347c-4e71-a8f7-0625ce7e9d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:40.231622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6539-347c-4e71-a8f7-0625ce7e9d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:40.232144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6539-347c-4e71-a8f7-0625ce7e9d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:40.232697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6539-347c-4e71-a8f7-0625ce7e9d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:40.263098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e6539-347c-4e71-a8f7-0625ce7e9d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:40.263098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e6539-347c-4e71-a8f7-0625ce7e9d6a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:40.275065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1115/2256] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:40.747214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:40.748877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:40.799005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71283f-60e6-41ea-b8e4-51ff1ab78d8f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:40.816262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:40.818223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:40.818632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:40.819546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] PATH_INFO: `/v3/projects/133652e51dc542f9a5ac6cc44c4d8bb5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:40.823555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] RBAC: Authorizing `identity:delete_project(project_id=133652e51dc542f9a5ac6cc44c4d8bb5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:40.827632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:41.032083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133652e51dc542f9a5ac6cc44c4d8bb5', 'request_id': 'req-c39c0cc5-739d-4b6d-9e26-b0190027838f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:41.040725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133652e51dc542f9a5ac6cc44c4d8bb5', 'request_id': 'req-c39c0cc5-739d-4b6d-9e26-b0190027838f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:41.045208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:41.242077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133652e51dc542f9a5ac6cc44c4d8bb5', 'request_id': 'req-c39c0cc5-739d-4b6d-9e26-b0190027838f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:41.261556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] The token cache is being invalidate because project 133652e51dc542f9a5ac6cc44c4d8bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:41.262066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:41.262789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:41.264822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1142/2257] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:40 2022] DELETE /identity/v3/projects/133652e51dc542f9a5ac6cc44c4d8bb5 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:42.700201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:42.805825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:43.936840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a703b1-744b-49b7-b3b3-64cc066389c1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:43.942807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a703b1-744b-49b7-b3b3-64cc066389c1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:43.942807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a703b1-744b-49b7-b3b3-64cc066389c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:43.972642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-51a703b1-744b-49b7-b3b3-64cc066389c1 None None] MFA Rules not processed for user `2e56b9ff50c7434fbd7745a950628f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:43.979109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-51a703b1-744b-49b7-b3b3-64cc066389c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:44.108374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:44.131631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1116/2258] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:44.267627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:46.083957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.085763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.186644 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c0cc5-739d-4b6d-9e26-b0190027838f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:46.195442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:46.200761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.201279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.203123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] PATH_INFO: `/v3/users/d0e991e489334961a18a96d1a3602d15` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.205279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e991e489334961a18a96d1a3602d15)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:46.208184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:46.550981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e991e489334961a18a96d1a3602d15'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.552188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e991e489334961a18a96d1a3602d15'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.571212 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e991e489334961a18a96d1a3602d15'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.598461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e991e489334961a18a96d1a3602d15'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.666812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e991e489334961a18a96d1a3602d15'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.677791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1143/2259] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:46 2022] DELETE /identity/v3/users/d0e991e489334961a18a96d1a3602d15 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:46.682585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.683268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.683268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.715019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:46.717609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.775773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:46.847917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1117/2260] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:46.857830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.863295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.876476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:47.030156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ddea8-12ab-4c9c-9e6b-0892e70fce4e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.048199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.049008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.049401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.049760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.085127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.087788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.103815 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1144/2261] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:47.856498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:47.935793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:47.937799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:47.953010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070159e5-a0c9-4dfe-b368-09cf2259275a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.959643 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.965759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.965759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.965759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] PATH_INFO: `/v3/projects/47b8aa2f8b5d4dc59a914a99d054b15a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.965759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b8aa2f8b5d4dc59a914a99d054b15a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.973189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:48.180488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b8aa2f8b5d4dc59a914a99d054b15a', 'request_id': 'req-16a7ba7a-a026-444c-82ce-89fed5d116c2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:48.190693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b8aa2f8b5d4dc59a914a99d054b15a', 'request_id': 'req-16a7ba7a-a026-444c-82ce-89fed5d116c2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:48.300891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b8aa2f8b5d4dc59a914a99d054b15a', 'request_id': 'req-16a7ba7a-a026-444c-82ce-89fed5d116c2'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:48.323311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] The token cache is being invalidate because project 47b8aa2f8b5d4dc59a914a99d054b15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:48.325002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:48.326205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:48.328304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1118/2262] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:47 2022] DELETE /identity/v3/projects/47b8aa2f8b5d4dc59a914a99d054b15a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:48.333435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:48.340042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:48.350230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d04b1-3706-45bd-ae33-949846848d1a service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:48.476401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:48.486015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:48.486592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:48.488630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] PATH_INFO: `/v3/users/bc56ef1db4fb4d708346ec92d3875382` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:48.491190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc56ef1db4fb4d708346ec92d3875382)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:48.497071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:48.804254 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:49.233289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc56ef1db4fb4d708346ec92d3875382'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:49.234068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc56ef1db4fb4d708346ec92d3875382'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:49.249788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc56ef1db4fb4d708346ec92d3875382'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:49.273975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc56ef1db4fb4d708346ec92d3875382'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:49.351202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7b1d79cb-cb31-4196-99f5-dcb9e67667f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc56ef1db4fb4d708346ec92d3875382'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:49.372354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1145/2263] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:48 2022] DELETE /identity/v3/users/bc56ef1db4fb4d708346ec92d3875382 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:50.124371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:50.126411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:50.177220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ba7a-a026-444c-82ce-89fed5d116c2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:50.260993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:50.261982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:50.262434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:50.262870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] PATH_INFO: `/v3/projects/aeeea4acdd6d4dc98e0d67e6e91c8829` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:50.265705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeeea4acdd6d4dc98e0d67e6e91c8829)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:50.267750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:50.396173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeeea4acdd6d4dc98e0d67e6e91c8829', 'request_id': 'req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:50.404701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeeea4acdd6d4dc98e0d67e6e91c8829', 'request_id': 'req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:50.408701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:50.493931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeeea4acdd6d4dc98e0d67e6e91c8829', 'request_id': 'req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:50.506817 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] The token cache is being invalidate because project aeeea4acdd6d4dc98e0d67e6e91c8829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:50.513559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:50.513559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3be7bdde-d493-4aa0-a938-1e1aaf892b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:50.513559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1119/2264] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:50 2022] DELETE /identity/v3/projects/aeeea4acdd6d4dc98e0d67e6e91c8829 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:50.518952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:50.521444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:50.522365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:50.548148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:50.549683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:50.632759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1146/2265] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:50.646636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:50.646636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:50.646636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:50.667632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:50.669997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:50.681762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1120/2266] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:50.687467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:50.699846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd7a0-d0d9-4b17-af8f-f2824f45a3ad None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:50.705116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:50.705809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:50.706124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:50.706402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:50.707068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:50.707371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:50.709018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:50.726660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1147/2267] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:10:50.728310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:50.739323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d996e-e77a-4013-a802-5a438847edd0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:50.744351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:50.744983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:50.745287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:50.745559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:50.746245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:50.748154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:50.937934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1121/2268] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:50 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:50.940098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:50.958462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a91eb3-49bb-4018-b994-856405161e68 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:51.089811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:51.091088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:51.091380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:51.091659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:51.092514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:51.103387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:51.135621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:51.282173 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1148/2269] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:50 2022] POST /identity/v3/users => generated 294 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:51.286493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:51.307981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51da1-c18c-4219-8337-8a1488b8408a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:51.316530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:51.317447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:51.317903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:51.318355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:51.321396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:51.323696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:51.351572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1122/2270] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:51.353361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:51.368651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f83875-0283-4c0e-af96-52faaa7ea1b1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:51.385313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdab8b-40d0-478f-8273-931c32a5b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:51.386006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdab8b-40d0-478f-8273-931c32a5b36e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:51.386288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdab8b-40d0-478f-8273-931c32a5b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:51.386560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdab8b-40d0-478f-8273-931c32a5b36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:51.387221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdab8b-40d0-478f-8273-931c32a5b36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:51.388863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdab8b-40d0-478f-8273-931c32a5b36e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:51.426744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1149/2271] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:10:51.427585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:51.446082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e613e-38ec-47da-b1de-e40426b5655e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:51.457198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:51.457678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:51.457993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:51.458291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] PATH_INFO: `/v3/projects/f13a920bfa104a55b9aaa68f4926bfda/users/0d3f515f152640828753d24eac061c83/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:51.502995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13a920bfa104a55b9aaa68f4926bfda, user_id=0d3f515f152640828753d24eac061c83, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:51.506049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:51.590006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1123/2272] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:51 2022] PUT /identity/v3/projects/f13a920bfa104a55b9aaa68f4926bfda/users/0d3f515f152640828753d24eac061c83/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:51.614781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:51.616504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:51.617294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:51.656424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:51.738601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] MFA Rules not processed for user `0d3f515f152640828753d24eac061c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:51.740183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:51.755128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:51.853330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1150/2273] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:51.857576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:51.962459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:51.976866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa727c-788f-4916-b94f-49f1f1db878b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:51.984199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:51.988349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:51.989647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:51.990269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:51.994972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:51.995406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:52.115118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:52.122206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1124/2274] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:51 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:52.146444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b23d23-daaf-4c71-8310-f3ce7a50c41b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:52.256638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:52.257693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:52.258099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:52.258497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:52.259307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:52.275145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:52.431694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1151/2275] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:52 2022] POST /identity/v3/users => generated 300 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:52.432724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:52.447577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97db02-d7fc-4b5e-9cdb-e03e69366383 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:52.481408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:52.488127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:52.488127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:52.488127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:52.488127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:52.488127 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:52.535714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:52.545792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1125/2276] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:52.550368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:52.575608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9db5-4675-4341-9482-35bcd5d73e6e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:52.589358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:52.590377 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:52.590669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:52.590950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] PATH_INFO: `/v3/projects/e3d9949988e943aa9307cbdb935c2392/users/45ec0d5441734f74875cd1107d6b4297/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:52.611998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d9949988e943aa9307cbdb935c2392, user_id=45ec0d5441734f74875cd1107d6b4297, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:52.614823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:52.728864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1152/2277] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:52 2022] PUT /identity/v3/projects/e3d9949988e943aa9307cbdb935c2392/users/45ec0d5441734f74875cd1107d6b4297/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:52.733093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:52.754319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369292bd-04be-4862-8066-53fdef059343 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:52.862212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928129ae-450b-42da-a5a3-ae1d886a0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:52.862877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928129ae-450b-42da-a5a3-ae1d886a0382 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:52.864148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928129ae-450b-42da-a5a3-ae1d886a0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:52.864447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928129ae-450b-42da-a5a3-ae1d886a0382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:52.865468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928129ae-450b-42da-a5a3-ae1d886a0382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:52.867415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928129ae-450b-42da-a5a3-ae1d886a0382 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:52.886051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1126/2278] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:52.890324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:52.910513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4fa8-ec13-4704-aaee-46d3652c5866 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:52.925110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:52.927106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:52.927106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:52.927106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] PATH_INFO: `/v3/projects/e3d9949988e943aa9307cbdb935c2392/users/45ec0d5441734f74875cd1107d6b4297/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:52.933887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d9949988e943aa9307cbdb935c2392, user_id=45ec0d5441734f74875cd1107d6b4297, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:52.937230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:52.963184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1153/2279] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:52 2022] PUT /identity/v3/projects/e3d9949988e943aa9307cbdb935c2392/users/45ec0d5441734f74875cd1107d6b4297/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:52.988117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:52.988769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:52.989223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:53.091816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] MFA Rules not processed for user `45ec0d5441734f74875cd1107d6b4297`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:53.093398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:53.156100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=73,keystone:DELETE=21,keystone:INSERT=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:53.255991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:53.270572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1127/2280] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:53.292200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:53.295682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:53.402620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474aca4-ddb0-40fb-b12a-d981240469c5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:53.407593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6513c-e54f-46c2-9c49-8866de31d6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:53.408312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6513c-e54f-46c2-9c49-8866de31d6ef service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:53.408730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6513c-e54f-46c2-9c49-8866de31d6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:53.409075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6513c-e54f-46c2-9c49-8866de31d6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:53.436122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6513c-e54f-46c2-9c49-8866de31d6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:53.438974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6513c-e54f-46c2-9c49-8866de31d6ef service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:53.472596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1154/2281] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:53.527103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:53.666311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621067c2-ea9a-4b66-8b51-a11f7f7bd19a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:53.681347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:53.686382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:53.686382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:53.686382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] PATH_INFO: `/v3/users/0d3f515f152640828753d24eac061c83` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:53.686382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3f515f152640828753d24eac061c83)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:53.686382 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:53.930678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3f515f152640828753d24eac061c83'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:53.931375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3f515f152640828753d24eac061c83'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:53.956256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3f515f152640828753d24eac061c83'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:54.057636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3f515f152640828753d24eac061c83'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:54.063889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3f515f152640828753d24eac061c83'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:54.116026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1128/2282] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:53 2022] DELETE /identity/v3/users/0d3f515f152640828753d24eac061c83 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:54.120525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:54.126111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:54.127016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:54.179974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:54.181739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:54.282848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1155/2283] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:54.294659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:54.297315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:54.462963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdc9c0-6f2e-44a4-9e42-a413bf73c593 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:54.487609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:54.488870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:54.489390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:54.489896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:54.508397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:54.509877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:54.521090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1129/2284] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:55.134079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:55.134079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:55.152757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27440-64d9-496e-b0c1-e79e9d92f6fb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:55.169705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:55.171152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:55.173355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:55.174073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] PATH_INFO: `/v3/projects/f13a920bfa104a55b9aaa68f4926bfda` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:55.176300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13a920bfa104a55b9aaa68f4926bfda)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:55.179090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:55.369519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:55.816606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13a920bfa104a55b9aaa68f4926bfda', 'request_id': 'req-e91b99cd-432a-4138-8141-28dfb02dcc64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:55.825389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13a920bfa104a55b9aaa68f4926bfda', 'request_id': 'req-e91b99cd-432a-4138-8141-28dfb02dcc64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:55.935500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13a920bfa104a55b9aaa68f4926bfda', 'request_id': 'req-e91b99cd-432a-4138-8141-28dfb02dcc64'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:55.948756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] The token cache is being invalidate because project f13a920bfa104a55b9aaa68f4926bfda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:55.949168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:55.950178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:55.951933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1156/2285] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:55 2022] DELETE /identity/v3/projects/f13a920bfa104a55b9aaa68f4926bfda => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:55.958098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:55.968552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:55.973212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51762233-83ea-4236-a56b-c3235b25e6d5 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:56.053184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245184-7c01-4768-a735-527224426228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:56.054065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245184-7c01-4768-a735-527224426228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:56.054445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245184-7c01-4768-a735-527224426228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:56.054810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245184-7c01-4768-a735-527224426228 admin admin] PATH_INFO: `/v3/users/45ec0d5441734f74875cd1107d6b4297` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:56.060324 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245184-7c01-4768-a735-527224426228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ec0d5441734f74875cd1107d6b4297)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:56.063846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245184-7c01-4768-a735-527224426228 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:56.343145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95245184-7c01-4768-a735-527224426228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ec0d5441734f74875cd1107d6b4297'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:56.344067 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95245184-7c01-4768-a735-527224426228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ec0d5441734f74875cd1107d6b4297'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:56.363576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95245184-7c01-4768-a735-527224426228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ec0d5441734f74875cd1107d6b4297'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:56.477874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95245184-7c01-4768-a735-527224426228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ec0d5441734f74875cd1107d6b4297'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:56.478682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-95245184-7c01-4768-a735-527224426228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ec0d5441734f74875cd1107d6b4297'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:56.503187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1130/2286] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:55 2022] DELETE /identity/v3/users/45ec0d5441734f74875cd1107d6b4297 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:57.005608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.005608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:57.020478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b99cd-432a-4138-8141-28dfb02dcc64 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.113796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245184-7c01-4768-a735-527224426228 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.115221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-95245184-7c01-4768-a735-527224426228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:57.115548 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.116197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.116474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.116747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] PATH_INFO: `/v3/projects/e3d9949988e943aa9307cbdb935c2392` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.117937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d9949988e943aa9307cbdb935c2392)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.120271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.180312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245184-7c01-4768-a735-527224426228 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.180312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.180312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.180312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.180788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.182157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:57.245915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d9949988e943aa9307cbdb935c2392', 'request_id': 'req-303da8b7-cbd0-4184-95ce-be943eb5eccd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:57.248186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.250245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a2cf-8ec3-4066-a614-27e9f27d74b0 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.253099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d9949988e943aa9307cbdb935c2392', 'request_id': 'req-303da8b7-cbd0-4184-95ce-be943eb5eccd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:57.261427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1131/2287] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:57.267791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797015-f848-45a5-bd8d-4454b9560c82 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.267791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797015-f848-45a5-bd8d-4454b9560c82 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.267791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39797015-f848-45a5-bd8d-4454b9560c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.284303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-39797015-f848-45a5-bd8d-4454b9560c82 None None] MFA Rules not processed for user `d452e82ec89e447db772b6732e963ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:57.285569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-39797015-f848-45a5-bd8d-4454b9560c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:57.351229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1132/2288] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:57.363446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d9949988e943aa9307cbdb935c2392', 'request_id': 'req-303da8b7-cbd0-4184-95ce-be943eb5eccd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:57.375889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] The token cache is being invalidate because project e3d9949988e943aa9307cbdb935c2392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:57.376187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:57.376846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-303da8b7-cbd0-4184-95ce-be943eb5eccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:57.378768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1157/2289] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:56 2022] DELETE /identity/v3/projects/e3d9949988e943aa9307cbdb935c2392 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:57.383517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.383812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.384090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.415404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:57.415404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:57.496465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1133/2290] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:57.506695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.507292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.507785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.532326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:57.533566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:57.545683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1158/2291] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:57.551129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.564489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469f7a2-3a42-4d6d-b4f5-353220aa16c0 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.571418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.573756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.573756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.573756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.573756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:57.573756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.575345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.587779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1134/2292] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:10:57.592817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.603590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0452b-5755-4303-9940-978caaef2c7d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.609274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.610106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.610395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.610667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.611356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.613366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.748620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1159/2293] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:57 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:57.753381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.764154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42118-4ab4-425c-9804-b6dcbfbc5e64 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.830369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.832165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:57.832752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.833243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.833520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.834189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.837966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.917307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1135/2294] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:57 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:57.922220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.933368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42063a9a-b1bf-44e1-ab26-8b85b2eaccd3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.938247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.942719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.942719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.942719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.942719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.942719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.956440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1160/2295] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:10:57.957644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:57.969572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefc20e-9a4b-4bc9-b7d6-c42e6d12f746 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:57.974794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664adac-0566-46f4-a209-f632c027a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:57.975410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664adac-0566-46f4-a209-f632c027a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:57.975694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664adac-0566-46f4-a209-f632c027a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:57.975970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664adac-0566-46f4-a209-f632c027a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:57.976611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664adac-0566-46f4-a209-f632c027a5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:57.978262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664adac-0566-46f4-a209-f632c027a5bb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:57.990139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1136/2296] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:57.994179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:58.004304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b529-b5a9-491f-9716-04ffa345dd8c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:58.012632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:58.012632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:58.012632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:58.012632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] PATH_INFO: `/v3/projects/a4eab791d98942a58bf50ba290d7e39c/users/76c29abd9fd840a2b4f94ea95d582f4d/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:58.028950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4eab791d98942a58bf50ba290d7e39c, user_id=76c29abd9fd840a2b4f94ea95d582f4d, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:58.033204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:58.129309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1161/2297] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:57 2022] PUT /identity/v3/projects/a4eab791d98942a58bf50ba290d7e39c/users/76c29abd9fd840a2b4f94ea95d582f4d/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:58.140150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:58.140439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:58.140716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:58.169716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] MFA Rules not processed for user `76c29abd9fd840a2b4f94ea95d582f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:58.171009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:58.234174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:58.265025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1137/2298] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:58.269899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:58.404730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599914df-24f1-4c03-85e8-0fa2c043cb92 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:58.411574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:58.412200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:58.412560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:58.412734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:58.413375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:58.415482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:58.542500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1162/2299] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:58 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:58.550042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:58.561297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0092b7c-834c-4722-90fc-4e20edf4a79c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:58.643635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:58.645175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:58.645987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:58.646727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:58.647827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:58.651535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:58.782962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1138/2300] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:58 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:58.786867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:58.800431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1f14e-de81-4cce-a466-fb8f5c5509dd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:58.806157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:58.806762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:58.807044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:58.807318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:58.808017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:58.809623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:58.821091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1163/2301] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:58.847352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:58.858019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58754571-e2bf-43fd-b787-aae04eff3c8a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:58.862683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:58.863346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:58.863634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:58.863915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] PATH_INFO: `/v3/projects/b5caa16264e94d21bd3537cff7bd6c8d/users/2fe0e1f816104212b7460485a2a93503/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:58.880532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5caa16264e94d21bd3537cff7bd6c8d, user_id=2fe0e1f816104212b7460485a2a93503, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:58.883313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:58.956518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1139/2302] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:58 2022] PUT /identity/v3/projects/b5caa16264e94d21bd3537cff7bd6c8d/users/2fe0e1f816104212b7460485a2a93503/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:58.963181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:58.974077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d3f95-7119-495f-900a-d1bcdbf2fe84 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:59.030304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8efd09-da27-4f6f-9663-b352466ee99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:59.030958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8efd09-da27-4f6f-9663-b352466ee99f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:59.031171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8efd09-da27-4f6f-9663-b352466ee99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:59.031446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8efd09-da27-4f6f-9663-b352466ee99f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:59.032163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8efd09-da27-4f6f-9663-b352466ee99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:59.033756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8efd09-da27-4f6f-9663-b352466ee99f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:59.043553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1164/2303] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:59.048648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:59.059087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991b77-f01d-4453-854d-b6b2188518f9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:59.060898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:59.065346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:59.066055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:59.066341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:59.066616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] PATH_INFO: `/v3/projects/b5caa16264e94d21bd3537cff7bd6c8d/users/2fe0e1f816104212b7460485a2a93503/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:59.068529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5caa16264e94d21bd3537cff7bd6c8d, user_id=2fe0e1f816104212b7460485a2a93503, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:59.071219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:59.081701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1140/2304] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:59 2022] PUT /identity/v3/projects/b5caa16264e94d21bd3537cff7bd6c8d/users/2fe0e1f816104212b7460485a2a93503/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:59.093016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:59.093368 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:59.093782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:59.123679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] MFA Rules not processed for user `2fe0e1f816104212b7460485a2a93503`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:59.125520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:59.192628 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1165/2305] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:10:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:59.203708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:59.205423 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:59.265185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469b80e-f035-4778-ae36-d2650648cee3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:59.269657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e85a62-2737-4d77-bc20-d3a2bbf37651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:59.270425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e85a62-2737-4d77-bc20-d3a2bbf37651 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:59.270708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e85a62-2737-4d77-bc20-d3a2bbf37651 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:59.270982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e85a62-2737-4d77-bc20-d3a2bbf37651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:59.281617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e85a62-2737-4d77-bc20-d3a2bbf37651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:59.283211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e85a62-2737-4d77-bc20-d3a2bbf37651 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:59.292981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1141/2306] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:59.804086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:59.885239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:59.947514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9d4dd-f864-401a-8a2a-57be9d20f9b8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:59.953306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:59.953963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:59.954308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:59.954578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] PATH_INFO: `/v3/users/76c29abd9fd840a2b4f94ea95d582f4d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:59.955700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c29abd9fd840a2b4f94ea95d582f4d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:59.957661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:00.160931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c29abd9fd840a2b4f94ea95d582f4d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:00.161692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c29abd9fd840a2b4f94ea95d582f4d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:00.169220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c29abd9fd840a2b4f94ea95d582f4d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:00.181611 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c29abd9fd840a2b4f94ea95d582f4d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:00.260839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c29abd9fd840a2b4f94ea95d582f4d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:00.268319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1166/2307] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:59 2022] DELETE /identity/v3/users/76c29abd9fd840a2b4f94ea95d582f4d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:00.273052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:00.276601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:00.276601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:00.293425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:00.294668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:00.354380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1142/2308] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:00.364219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:00.365634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:00.424062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3be87e-38f1-474b-ae7f-2af84b0b0fa7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:00.427812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:00.428427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:00.428721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:00.429022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:00.439629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:00.441166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:00.451692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1167/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:00.706846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:00.929374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:00.930906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:00.943235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93e7da-a005-4662-945f-4fc8e6eae004 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:00.948840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:00.949526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:00.949756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:00.950065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] PATH_INFO: `/v3/projects/a4eab791d98942a58bf50ba290d7e39c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:00.952032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4eab791d98942a58bf50ba290d7e39c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:00.954263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:01.090989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4eab791d98942a58bf50ba290d7e39c', 'request_id': 'req-0289f6f2-d303-4c65-ac45-b4777b3e12ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.099132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4eab791d98942a58bf50ba290d7e39c', 'request_id': 'req-0289f6f2-d303-4c65-ac45-b4777b3e12ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.215523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4eab791d98942a58bf50ba290d7e39c', 'request_id': 'req-0289f6f2-d303-4c65-ac45-b4777b3e12ee'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.228229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] The token cache is being invalidate because project a4eab791d98942a58bf50ba290d7e39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:01.228529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.229297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.230906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1143/2310] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:00 2022] DELETE /identity/v3/projects/a4eab791d98942a58bf50ba290d7e39c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:01.234888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:01.245915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb3f2f-e391-430b-abcd-a6643624d570 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:01.308853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:01.309883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:01.310162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:01.310437 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] PATH_INFO: `/v3/users/2fe0e1f816104212b7460485a2a93503` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:01.311642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe0e1f816104212b7460485a2a93503)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:01.313828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:01.596925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe0e1f816104212b7460485a2a93503'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.597621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe0e1f816104212b7460485a2a93503'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.609257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:01.617184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe0e1f816104212b7460485a2a93503'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.633274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe0e1f816104212b7460485a2a93503'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.728999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-86603573-d320-4a8d-96c2-b8ed0d4e44c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe0e1f816104212b7460485a2a93503'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:01.738864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1168/2311] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:01 2022] DELETE /identity/v3/users/2fe0e1f816104212b7460485a2a93503 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:02.125879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:02.432100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:02.434259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:02.470964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289f6f2-d303-4c65-ac45-b4777b3e12ee admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:02.554591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:02.555600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:02.556038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:02.556364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] PATH_INFO: `/v3/projects/b5caa16264e94d21bd3537cff7bd6c8d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:02.557691 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5caa16264e94d21bd3537cff7bd6c8d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:02.559711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:02.745818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5caa16264e94d21bd3537cff7bd6c8d', 'request_id': 'req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:02.752676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5caa16264e94d21bd3537cff7bd6c8d', 'request_id': 'req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:02.917663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5caa16264e94d21bd3537cff7bd6c8d', 'request_id': 'req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:02.935140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] The token cache is being invalidate because project b5caa16264e94d21bd3537cff7bd6c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:02.935140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:02.935140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-b051d8ba-8c4d-4d7b-8ba2-45fb4d32c8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:02.936420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1144/2312] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:02 2022] DELETE /identity/v3/projects/b5caa16264e94d21bd3537cff7bd6c8d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:02.944520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ec465-12d4-411b-8dd0-6f0f04fdce18 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:02.945064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ec465-12d4-411b-8dd0-6f0f04fdce18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:02.945064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ec465-12d4-411b-8dd0-6f0f04fdce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:02.984627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7a6ec465-12d4-411b-8dd0-6f0f04fdce18 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:02.984627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7a6ec465-12d4-411b-8dd0-6f0f04fdce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:02.984830 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:02.985259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:02.985621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.009824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:03.011128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:03.062641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1169/2313] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:03.064805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.065357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.065622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.074636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1145/2314] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:11:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:03.087308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:03.088680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:03.089820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.091968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:03.097088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1170/2315] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:03.101435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.111221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0120c0b-6b6f-42c0-959a-ed8c8c66190f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.117758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.118734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.119190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.119512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.120317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:11:03.120689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.122421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.138256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1171/2316] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:11:03.143484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.156558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f750-c8a1-4e7d-8d6a-ab3eb7cc0edc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.161388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.162050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.162331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.162609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.163240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.165272 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.182165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff113022-b6be-4522-9ff7-74b0f265c5f1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.188393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.188528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.188788 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.189063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.197490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.199116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.208300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1146/2317] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:11:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:11:03.279565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1172/2318] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:03 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:03.293286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.307721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057bd86-31d9-493a-9192-0f1838b7254e service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.374932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.375574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.375907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.376209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.376855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.379248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.498390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1147/2319] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:03 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:03.510526 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.563041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ff48-fa35-4912-95a2-52c0f40444ca admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.597603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.599277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.600030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.600700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.602398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.606976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.650803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1173/2320] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:11:03.658313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.721583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b510-c4a2-45da-9bdd-81055c9bdd69 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.738346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42e1c5-863d-4df6-b21f-18bdd3bdd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.739208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42e1c5-863d-4df6-b21f-18bdd3bdd02e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.750743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42e1c5-863d-4df6-b21f-18bdd3bdd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.752305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42e1c5-863d-4df6-b21f-18bdd3bdd02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.754151 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42e1c5-863d-4df6-b21f-18bdd3bdd02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.755842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42e1c5-863d-4df6-b21f-18bdd3bdd02e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.767035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:03.782186 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1148/2321] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:03.784097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:03.811752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19b27a-647f-4746-a12a-468e60785c4a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:03.834422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:03.835458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.835940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.836580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] PATH_INFO: `/v3/projects/00806e8eb8c14a54817b741aedc81217/users/776c561d137f4a48aadf960b706af8e6/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:03.865492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00806e8eb8c14a54817b741aedc81217, user_id=776c561d137f4a48aadf960b706af8e6, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:03.882856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:03.972144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1174/2322] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:03 2022] PUT /identity/v3/projects/00806e8eb8c14a54817b741aedc81217/users/776c561d137f4a48aadf960b706af8e6/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:03.984398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:03.985201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:03.985773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:04.067947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] MFA Rules not processed for user `776c561d137f4a48aadf960b706af8e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:04.067947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:04.088596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:04.214964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1149/2323] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:04.229814 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:04.231869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:04.338362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0e016-eab2-4b08-a1d3-d54635736824 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:04.343194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4167-7754-4af2-b9e2-4706fcf0d66d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:04.351371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4167-7754-4af2-b9e2-4706fcf0d66d service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:04.351371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4167-7754-4af2-b9e2-4706fcf0d66d service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:04.351371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4167-7754-4af2-b9e2-4706fcf0d66d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:04.354292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4167-7754-4af2-b9e2-4706fcf0d66d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:04.355853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4167-7754-4af2-b9e2-4706fcf0d66d service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:04.366499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1175/2324] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:04.392369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:04.540344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5b4c-a4a4-40fb-8405-b7669a935d84 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:04.550218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94196824-f966-4714-a412-418271acdb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:04.555375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94196824-f966-4714-a412-418271acdb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:04.556057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94196824-f966-4714-a412-418271acdb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:04.556540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94196824-f966-4714-a412-418271acdb80 admin admin] PATH_INFO: `/v3/users/776c561d137f4a48aadf960b706af8e6` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:04.563236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94196824-f966-4714-a412-418271acdb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776c561d137f4a48aadf960b706af8e6)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:04.567071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94196824-f966-4714-a412-418271acdb80 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:04.803753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab1baf-4cb1-4059-ac61-b13b13f8ad43 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:04.804686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab1baf-4cb1-4059-ac61-b13b13f8ad43 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:04.805478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab1baf-4cb1-4059-ac61-b13b13f8ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:04.831697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-57ab1baf-4cb1-4059-ac61-b13b13f8ad43 None None] MFA Rules not processed for user `1416ea3d97ef4396ab8975a4d43bbdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:04.834104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-57ab1baf-4cb1-4059-ac61-b13b13f8ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:04.891873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1176/2325] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:04.912786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776c561d137f4a48aadf960b706af8e6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:04.914943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776c561d137f4a48aadf960b706af8e6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:04.944906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776c561d137f4a48aadf960b706af8e6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:05.019522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776c561d137f4a48aadf960b706af8e6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:05.020319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776c561d137f4a48aadf960b706af8e6'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:05.037746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1150/2326] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:04 2022] DELETE /identity/v3/users/776c561d137f4a48aadf960b706af8e6 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:05.043321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:05.043811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:05.044121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:05.090524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:05.092113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:05.188403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1177/2327] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:05.205907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:05.220361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:05.304116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94196824-f966-4714-a412-418271acdb80 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:05.309032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a80aa3-440b-465f-b960-65109e6717aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:05.309675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80aa3-440b-465f-b960-65109e6717aa service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:05.310034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80aa3-440b-465f-b960-65109e6717aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:05.310392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a80aa3-440b-465f-b960-65109e6717aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:05.320598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a80aa3-440b-465f-b960-65109e6717aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:05.322111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a80aa3-440b-465f-b960-65109e6717aa service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:05.333428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1151/2328] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:05.684106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:05.924510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:06.448600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:06.449475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:06.486919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe2862-8421-4116-85fa-fe5d0a657eab None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:06.493427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:06.493427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:06.493427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:06.493427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] PATH_INFO: `/v3/projects/00806e8eb8c14a54817b741aedc81217` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:06.494839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00806e8eb8c14a54817b741aedc81217)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:06.496949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:06.506644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:06.640851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00806e8eb8c14a54817b741aedc81217', 'request_id': 'req-11da627a-790b-4281-bb80-f719c4affd3c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:06.647835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00806e8eb8c14a54817b741aedc81217', 'request_id': 'req-11da627a-790b-4281-bb80-f719c4affd3c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:06.836953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00806e8eb8c14a54817b741aedc81217', 'request_id': 'req-11da627a-790b-4281-bb80-f719c4affd3c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:06.849874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] The token cache is being invalidate because project 00806e8eb8c14a54817b741aedc81217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:06.850186 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:06.850880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-11da627a-790b-4281-bb80-f719c4affd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:06.852395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1178/2329] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:06 2022] DELETE /identity/v3/projects/00806e8eb8c14a54817b741aedc81217 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:06.857553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:06.858175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:06.858175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:06.879656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:06.880916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:06.955122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1152/2330] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:06.964121 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:06.964445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:06.964722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:06.985701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:06.996760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:06.996760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1179/2331] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:07.000281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:07.010330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f9a27-dcdc-459f-82d4-9c1056ea7adc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:07.015543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:07.016181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:07.016502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:07.016812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:07.017505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:11:07.017836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:07.019486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:07.032213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1153/2332] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:11:07.036559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:07.046259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521731af-ca43-4b24-b808-8d7c0e8c3648 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:07.051484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:07.053036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:07.053036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:07.053036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:07.053384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:07.055237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:07.501041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1180/2333] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:07 2022] POST /identity/v3/projects => generated 383 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:07.506040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:07.521972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb363d-b8ab-4a6e-a0a1-4cce926a035d admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:07.569880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:07.619522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:07.620658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:07.621126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:07.621617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:07.622495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:07.627211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:07.755821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1154/2334] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:07 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:07.759413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:07.771193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83bb6-c6c4-4b34-bd3c-a184b61cc417 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:07.776933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:07.776933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:07.776933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:07.776933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:07.777519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:07.779259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:07.790353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1181/2335] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:07.796371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:07.823319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2e75-30d2-4954-a47f-04467d23424f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:07.831012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5614c5-22bb-494e-9637-147bc65597f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:07.831781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5614c5-22bb-494e-9637-147bc65597f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:07.832070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5614c5-22bb-494e-9637-147bc65597f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:07.832348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5614c5-22bb-494e-9637-147bc65597f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:07.833030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5614c5-22bb-494e-9637-147bc65597f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:07.834811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5614c5-22bb-494e-9637-147bc65597f1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:07.851310 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1155/2336] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:07.855743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:07.867120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7255c-a30c-4264-8640-d5be6f7ec1d8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:07.871984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:07.872653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:07.872938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:07.873220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] PATH_INFO: `/v3/projects/99fb9db9ba2a454cbba1e12687f9933d/users/75c274fe120c4c8d8f1f992cb17283fe/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:07.894199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fb9db9ba2a454cbba1e12687f9933d, user_id=75c274fe120c4c8d8f1f992cb17283fe, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:07.896865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:08.054515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1182/2337] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:07 2022] PUT /identity/v3/projects/99fb9db9ba2a454cbba1e12687f9933d/users/75c274fe120c4c8d8f1f992cb17283fe/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:08.064625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:08.070277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:08.070277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:08.098985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] MFA Rules not processed for user `75c274fe120c4c8d8f1f992cb17283fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:08.098985 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:08.168895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1156/2338] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:08.179608 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:08.181332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:08.274717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72e03-afa0-42d5-a85c-2ecdff454e65 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:08.279024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8f316-d5c0-4835-9bf4-d299fd3e57ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:08.279648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8f316-d5c0-4835-9bf4-d299fd3e57ce service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:08.280523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8f316-d5c0-4835-9bf4-d299fd3e57ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:08.280826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8f316-d5c0-4835-9bf4-d299fd3e57ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:08.293227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8f316-d5c0-4835-9bf4-d299fd3e57ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:08.296383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8f316-d5c0-4835-9bf4-d299fd3e57ce service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:08.318120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1183/2339] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:08.935802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:09.444458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:09.485036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:11.883639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:12.024756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:12.866047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:13.048010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:13.460899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:13.518899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:13.792209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:13.860148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:13.886952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:14.089454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:14.152051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:14.363518 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:14.557944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:14.879301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.020967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.488018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.518235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.603766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.752221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.775379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.910870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:15.940755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:16.112036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:16.175010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:16.413283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:16.820482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:17.134422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:17.288955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:17.563792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:17.638101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:18.541320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:18.672746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:18.724752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:18.740073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f67334-137e-4335-bc4d-5516e18c4401 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:18.745080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:18.751315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:18.751315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:18.751315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] PATH_INFO: `/v3/users/75c274fe120c4c8d8f1f992cb17283fe` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:18.751315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c274fe120c4c8d8f1f992cb17283fe)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:18.751315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:18.956225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c274fe120c4c8d8f1f992cb17283fe'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:18.957025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c274fe120c4c8d8f1f992cb17283fe'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:18.970079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c274fe120c4c8d8f1f992cb17283fe'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.078288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c274fe120c4c8d8f1f992cb17283fe'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.078964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c274fe120c4c8d8f1f992cb17283fe'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.092850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1157/2340] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:18 2022] DELETE /identity/v3/users/75c274fe120c4c8d8f1f992cb17283fe => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:19.097827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:19.101885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:19.101885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:19.121742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:19.122963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:19.190409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1184/2341] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:19.200807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:19.202746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:19.265440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1426c-94c6-46e8-a17e-2b3177792af6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:19.269233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476097-f31f-4936-bfa8-7d80a114826a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:19.269864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476097-f31f-4936-bfa8-7d80a114826a service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:19.270175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476097-f31f-4936-bfa8-7d80a114826a service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:19.270444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476097-f31f-4936-bfa8-7d80a114826a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:19.279856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476097-f31f-4936-bfa8-7d80a114826a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:19.281277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476097-f31f-4936-bfa8-7d80a114826a service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:19.291177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1158/2342] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:19.472694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:19.742224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:19.743692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:19.756452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914ee99-84b9-4451-9651-30a522d41686 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:19.761084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:19.761729 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:19.762038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:19.762315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] PATH_INFO: `/v3/projects/99fb9db9ba2a454cbba1e12687f9933d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:19.763647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fb9db9ba2a454cbba1e12687f9933d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:19.765599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:19.825048 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:19.895712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fb9db9ba2a454cbba1e12687f9933d', 'request_id': 'req-b3f6b7c2-4729-4864-b249-23dcdb7d0455'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.902745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fb9db9ba2a454cbba1e12687f9933d', 'request_id': 'req-b3f6b7c2-4729-4864-b249-23dcdb7d0455'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.969101 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fb9db9ba2a454cbba1e12687f9933d', 'request_id': 'req-b3f6b7c2-4729-4864-b249-23dcdb7d0455'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.981448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] The token cache is being invalidate because project 99fb9db9ba2a454cbba1e12687f9933d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:19.981738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.982419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3f6b7c2-4729-4864-b249-23dcdb7d0455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:19.984192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1185/2343] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:19 2022] DELETE /identity/v3/projects/99fb9db9ba2a454cbba1e12687f9933d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:19.989250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:19.989250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:19.989250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.011667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:20.012887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:20.085033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1159/2344] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:20.093958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.094247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.094523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.117114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:20.119468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:20.126866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1186/2345] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:20.132016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.143094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b218f5-4538-447f-b403-1315f9729ca7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.146018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:20.150772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.154031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.154031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.154031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.154031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:11:20.154031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.154544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.168139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1160/2346] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:11:20.173778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.186323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7190e4d-dcd0-4ffd-ac64-e2ab29b2eab5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.191227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.191839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.192115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.192384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.193018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.194988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.334454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1187/2347] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:20 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:11:20.337373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.347656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88e11c-d799-4884-8932-d116814ee582 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.404969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.405587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.405895 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.406172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.406804 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.408723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.443458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:20.495126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1161/2348] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:20 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:20.499736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.510546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795f8c-0b5b-455d-b92a-2f5b0555ddba admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.515860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.516461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.516745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.517030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.517669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.519486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.529659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1188/2349] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:20.533818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.544088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c75539-7893-4e30-bcbd-0e8961dd20cc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.548554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00587957-250c-469b-a44a-bbec964cbd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.549148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00587957-250c-469b-a44a-bbec964cbd67 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.549430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00587957-250c-469b-a44a-bbec964cbd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.549704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00587957-250c-469b-a44a-bbec964cbd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.550367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00587957-250c-469b-a44a-bbec964cbd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.551953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00587957-250c-469b-a44a-bbec964cbd67 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.562906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1162/2350] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:20.567043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.577890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d144-da2e-4b22-96d0-f8d659e0315e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.582489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.583195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.583424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.583696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] PATH_INFO: `/v3/projects/e166fc9fc7b64f62a6fc7ed13096be44/users/6c69d403816c441fbd215f85f2df854b/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.598522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e166fc9fc7b64f62a6fc7ed13096be44, user_id=6c69d403816c441fbd215f85f2df854b, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.601175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.717708 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1189/2351] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:20 2022] PUT /identity/v3/projects/e166fc9fc7b64f62a6fc7ed13096be44/users/6c69d403816c441fbd215f85f2df854b/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:20.729349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7edc2-5c7b-43b2-b93a-6d9df86198ab None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.729635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7edc2-5c7b-43b2-b93a-6d9df86198ab None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.729944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7edc2-5c7b-43b2-b93a-6d9df86198ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.760038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-57c7edc2-5c7b-43b2-b93a-6d9df86198ab None None] MFA Rules not processed for user `6c69d403816c441fbd215f85f2df854b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:20.761261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-57c7edc2-5c7b-43b2-b93a-6d9df86198ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:20.829894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1163/2352] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:20.841525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:20.843647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:20.902203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49452fe4-3551-458a-aa7a-e6c58ff54383 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:20.906041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701540cc-cf62-4941-a8ec-18827751fdfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:20.906645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701540cc-cf62-4941-a8ec-18827751fdfb service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:20.906948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701540cc-cf62-4941-a8ec-18827751fdfb service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:20.907224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701540cc-cf62-4941-a8ec-18827751fdfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:20.916160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701540cc-cf62-4941-a8ec-18827751fdfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:20.919898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701540cc-cf62-4941-a8ec-18827751fdfb service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:20.927534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1190/2353] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:21.020751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:21.057764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:21.468118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:22.353551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65bd3-8a5a-4b76-ae70-d7d8eff7ff93 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:22.354596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65bd3-8a5a-4b76-ae70-d7d8eff7ff93 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:22.354596 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65bd3-8a5a-4b76-ae70-d7d8eff7ff93 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:22.356209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1164/2354] 10.222.0.47 () {54 vars in 961 bytes} [Mon Oct 10 12:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:11:22.362181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e559642-4d63-4be5-837e-7bf56ad16cc9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:22.362767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e559642-4d63-4be5-837e-7bf56ad16cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:22.362908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e559642-4d63-4be5-837e-7bf56ad16cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:22.383752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4e559642-4d63-4be5-837e-7bf56ad16cc9 None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:22.384716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4e559642-4d63-4be5-837e-7bf56ad16cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:22.457137 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1191/2355] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Oct 10 12:11:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:22.466841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a65bd3-8a5a-4b76-ae70-d7d8eff7ff93 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:22.482370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a65bd3-8a5a-4b76-ae70-d7d8eff7ff93 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:22.487379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:22.487958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:22.488236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:22.488535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:22.490288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:22.503352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:22.504486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdaaf7-e29e-4da3-a440-fc012cafa6d9 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:22.515725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1165/2356] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:29.796229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222c199-eda9-4da6-afaa-a729b36ceea6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:29.797678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222c199-eda9-4da6-afaa-a729b36ceea6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:29.798360 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222c199-eda9-4da6-afaa-a729b36ceea6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:29.800902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1192/2357] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:11:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:11:29.811725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:29.815308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:29.815308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:29.835993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] MFA Rules not processed for user `6fa43b5c630e4d99af9a09bfad65d1cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:29.838164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:29.847541 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1166/2358] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:11:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:29.874090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222c199-eda9-4da6-afaa-a729b36ceea6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:29.876253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d222c199-eda9-4da6-afaa-a729b36ceea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:29.894662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222c199-eda9-4da6-afaa-a729b36ceea6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:29.903825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:29.904514 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:29.904807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:29.905074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:29.914871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:29.916843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:29.928270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1193/2359] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:30.857017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:30.859313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:30.912679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:30.940628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5492875-8f09-4547-86af-eda17e659e19 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:30.946187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:30.946952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:30.947240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:30.947523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] PATH_INFO: `/v3/users/59dcaf2559af4049979b151e275ea26e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:30.948692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59dcaf2559af4049979b151e275ea26e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:30.950693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:31.111101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59dcaf2559af4049979b151e275ea26e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.111693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59dcaf2559af4049979b151e275ea26e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.125992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59dcaf2559af4049979b151e275ea26e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.179081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59dcaf2559af4049979b151e275ea26e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.179757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59dcaf2559af4049979b151e275ea26e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.194193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1167/2360] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:30 2022] DELETE /identity/v3/users/59dcaf2559af4049979b151e275ea26e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:31.438415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:31.449220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe2594-83bc-4631-aaf0-785ed969db76 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:31.522229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:31.522862 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:31.523150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:31.523427 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] PATH_INFO: `/v3/projects/e7742c1e5d9145ddab8f41d4eccb25f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:31.524560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7742c1e5d9145ddab8f41d4eccb25f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:31.526570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:31.656560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:31.669072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7742c1e5d9145ddab8f41d4eccb25f2', 'request_id': 'req-a85c84d7-64d8-4388-a894-5384b7ea0142'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.675911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7742c1e5d9145ddab8f41d4eccb25f2', 'request_id': 'req-a85c84d7-64d8-4388-a894-5384b7ea0142'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.774659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7742c1e5d9145ddab8f41d4eccb25f2', 'request_id': 'req-a85c84d7-64d8-4388-a894-5384b7ea0142'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.786852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] The token cache is being invalidate because project e7742c1e5d9145ddab8f41d4eccb25f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:31.787144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.787812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:31.789361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1194/2361] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:31 2022] DELETE /identity/v3/projects/e7742c1e5d9145ddab8f41d4eccb25f2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:31.794004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:31.796051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:31.810072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccaaa0-2a14-4977-bee5-0e1d23ad2a62 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:31.871063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:31.871782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:31.871962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:31.872235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] PATH_INFO: `/v3/users/dcb14b32b38b414796bdc62838205f67` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:31.873361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb14b32b38b414796bdc62838205f67)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:31.875326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:32.074188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb14b32b38b414796bdc62838205f67'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.074875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb14b32b38b414796bdc62838205f67'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.086437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:32.088668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb14b32b38b414796bdc62838205f67'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.145362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb14b32b38b414796bdc62838205f67'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.146029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-06baf14b-7af3-44ee-9333-4785046bf75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb14b32b38b414796bdc62838205f67'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.160793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1168/2362] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:31 2022] DELETE /identity/v3/users/dcb14b32b38b414796bdc62838205f67 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:32.398834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:32.401773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:32.413359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c84d7-64d8-4388-a894-5384b7ea0142 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:32.481923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:32.482731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.482839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.483112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] PATH_INFO: `/v3/projects/bc42957a9137436cbfc2de58adffe8f7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.484241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc42957a9137436cbfc2de58adffe8f7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:32.486227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:32.607499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc42957a9137436cbfc2de58adffe8f7', 'request_id': 'req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.617531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc42957a9137436cbfc2de58adffe8f7', 'request_id': 'req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.685487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc42957a9137436cbfc2de58adffe8f7', 'request_id': 'req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.699976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] The token cache is being invalidate because project bc42957a9137436cbfc2de58adffe8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:32.700249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.700911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-23a21e03-9a88-4d0e-ae3e-3cc01055a9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:32.702535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1195/2363] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:32 2022] DELETE /identity/v3/projects/bc42957a9137436cbfc2de58adffe8f7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:32.707956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.709042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.709359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.732418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:32.734427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:32.822281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1169/2364] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:32.830109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.830445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.830730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.852891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:32.854463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:32.866489 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1196/2365] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:32.870948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:32.881823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f39e-65ea-4040-bfe4-afba3dce7d8c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:32.887346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:32.887976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.888260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.888688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.889418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:11:32.889735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:32.891433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:32.904251 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1170/2366] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:11:32.908861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:32.918565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb00e17-8452-4d71-8745-123f0fd22011 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:32.923761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:32.924588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.924963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.925147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.925798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:32.927743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.017079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1197/2367] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:32 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:33.021498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.032526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af218a-2d0f-4612-86f2-39a47a79d5f7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.094548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.095164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.095445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.095902 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.096508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.098871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.209737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1171/2368] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:33 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:33.213787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.226043 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1c5d8-6736-492f-9fe2-bbb9c2c13d9a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.232024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.233305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.233908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.234050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.234796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.236895 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.248816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1198/2369] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:33.253059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.264037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a673d-6050-47c7-9471-6b096627764a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.268969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f6a85-d7c1-4aba-ba1d-ccb732a9b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.269576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f6a85-d7c1-4aba-ba1d-ccb732a9b288 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.269863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f6a85-d7c1-4aba-ba1d-ccb732a9b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.270146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f6a85-d7c1-4aba-ba1d-ccb732a9b288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.270840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f6a85-d7c1-4aba-ba1d-ccb732a9b288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.272415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f6a85-d7c1-4aba-ba1d-ccb732a9b288 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.284348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1172/2370] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:11:33.291881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.303084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64015-3bf8-4295-9a2a-4bffb12d4812 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.307651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.308294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.308571 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.308843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] PATH_INFO: `/v3/projects/e8f4bad0871d49ef8567064e740cb54d/users/d07d2dc229654ffcaa7269542741cd00/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.326153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:33.333007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f4bad0871d49ef8567064e740cb54d, user_id=d07d2dc229654ffcaa7269542741cd00, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.335788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.426115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1199/2371] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:33 2022] PUT /identity/v3/projects/e8f4bad0871d49ef8567064e740cb54d/users/d07d2dc229654ffcaa7269542741cd00/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:33.436432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.436893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.437253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.468117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] MFA Rules not processed for user `d07d2dc229654ffcaa7269542741cd00`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:33.469491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:33.513068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:33.549724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1173/2372] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:33.554263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.619344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917b1c5-fe2d-421f-bfb2-64029e997543 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.623075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.623685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.623968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.624242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.624903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.627037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.731320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1200/2373] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:33 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:33.735608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.749184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce280ba-0c45-447c-a47a-a64a0ef61af1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.825579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.827140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.827497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.827848 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.829049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.832605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.941086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1174/2374] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:33 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:33.944402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:33.956246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d40233-b69d-4720-998a-1970251fd2a3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:33.961313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:33.962196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:33.962480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:33.962792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:33.963457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:33.965092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:33.980484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1201/2375] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:33.988537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.001339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de0e1-6c86-40bc-ac4e-fca9993e2515 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.008277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47ed77-0e6d-4f53-965c-f42f52a12651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.008277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47ed77-0e6d-4f53-965c-f42f52a12651 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.008491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47ed77-0e6d-4f53-965c-f42f52a12651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.008782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47ed77-0e6d-4f53-965c-f42f52a12651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.009932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47ed77-0e6d-4f53-965c-f42f52a12651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.012797 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47ed77-0e6d-4f53-965c-f42f52a12651 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.034786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1175/2376] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:11:34.036106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.047097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e0af-2d9d-4eda-be7a-2d7213505f1c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.051994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.052748 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.053016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.053312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] PATH_INFO: `/v3/projects/2502bc8d6a394baf9f2fb444f988ad7d/users/abd8bd913fc24ccbb2c494f619fce2ab/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.072307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2502bc8d6a394baf9f2fb444f988ad7d, user_id=abd8bd913fc24ccbb2c494f619fce2ab, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.075307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.203515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1202/2377] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:34 2022] PUT /identity/v3/projects/2502bc8d6a394baf9f2fb444f988ad7d/users/abd8bd913fc24ccbb2c494f619fce2ab/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:34.217047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.217454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.217713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.253192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] MFA Rules not processed for user `abd8bd913fc24ccbb2c494f619fce2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:34.254494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:34.334345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1176/2378] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:34.339659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.411521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1da52-e77a-4dc4-9ca7-9168f90bb63b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.416871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.417654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.417970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.418253 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.419018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.421804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.525072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1203/2379] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:34 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:34.529043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.540723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28289660-c2f8-4224-a6fe-3fba6ab6d367 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.584946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:34.602108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.602714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.603000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.603272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.603912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.605989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.724395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1177/2380] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:34 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:11:34.728473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.739763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff077f3-f490-4418-a8ca-d637207e35ee admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.744430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.745030 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.745311 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.745584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.746256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.747849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.760183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1204/2381] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:34.764719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.775726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124faab-241f-4548-9d88-df64108af571 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.781101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.781770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.782080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.782354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] PATH_INFO: `/v3/projects/ee3df6f266784ff292e9417fe6745667/users/024f728aa50c46d9adcd2de9e6dadb3a/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.799791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3df6f266784ff292e9417fe6745667, user_id=024f728aa50c46d9adcd2de9e6dadb3a, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.803079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.906339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1178/2382] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:34 2022] PUT /identity/v3/projects/ee3df6f266784ff292e9417fe6745667/users/024f728aa50c46d9adcd2de9e6dadb3a/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:34.910656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.921707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e753494-f868-40c1-bda0-cfa1c19af8a2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.930525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:34.985686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b3042-1ec5-4502-9015-213d652da5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.986322 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b3042-1ec5-4502-9015-213d652da5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.986603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b3042-1ec5-4502-9015-213d652da5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.986880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b3042-1ec5-4502-9015-213d652da5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.987523 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b3042-1ec5-4502-9015-213d652da5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.989306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b3042-1ec5-4502-9015-213d652da5a2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:35.001301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1205/2383] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:35.005898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:35.019025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c47997-c30b-42ba-8cba-20c72f338085 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:35.023860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:35.024543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:35.024829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:35.025111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] PATH_INFO: `/v3/projects/ee3df6f266784ff292e9417fe6745667/users/024f728aa50c46d9adcd2de9e6dadb3a/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:35.027123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3df6f266784ff292e9417fe6745667, user_id=024f728aa50c46d9adcd2de9e6dadb3a, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:35.030421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:35.041642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1179/2384] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:35 2022] PUT /identity/v3/projects/ee3df6f266784ff292e9417fe6745667/users/024f728aa50c46d9adcd2de9e6dadb3a/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:35.052363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:35.052731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:35.052899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:35.102233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] MFA Rules not processed for user `024f728aa50c46d9adcd2de9e6dadb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:35.103499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:35.190020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1206/2385] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:35.202445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:35.204688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:35.270368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a9df-9f1d-4f00-9438-1908d4fac621 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:35.274262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:35.274889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:35.275171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:35.275442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:35.351091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:35.352569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:35.362964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1180/2386] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:38.501072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:38.510778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116d7e1-955d-45c1-a9b3-be3fa682b8f9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:38.515472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:38.516067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:38.516348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:38.516622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:38.572863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:38.574332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:38.583812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1207/2387] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:40.185972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:40.197397 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5073c74-26d0-4e1c-a4ac-eb9bd94d4ec4 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:40.204593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f55ce1-a632-41c1-a1c8-64e53ba9d29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:40.204593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f55ce1-a632-41c1-a1c8-64e53ba9d29f service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:40.204593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f55ce1-a632-41c1-a1c8-64e53ba9d29f service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:40.204593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f55ce1-a632-41c1-a1c8-64e53ba9d29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:40.215407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f55ce1-a632-41c1-a1c8-64e53ba9d29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:40.226149 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f55ce1-a632-41c1-a1c8-64e53ba9d29f service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:40.242962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1181/2388] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:46.389238 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:46.437129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:46.481480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d180f-bc92-4506-9a99-04e5942f2c19 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:46.487036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:46.487545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:46.487821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:46.488094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] PATH_INFO: `/v3/users/d07d2dc229654ffcaa7269542741cd00` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:46.489266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07d2dc229654ffcaa7269542741cd00)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:46.491481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:46.686782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07d2dc229654ffcaa7269542741cd00'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:46.687480 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07d2dc229654ffcaa7269542741cd00'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:46.695565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07d2dc229654ffcaa7269542741cd00'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:46.708517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07d2dc229654ffcaa7269542741cd00'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:46.825300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07d2dc229654ffcaa7269542741cd00'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:46.832688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1208/2389] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:46 2022] DELETE /identity/v3/users/d07d2dc229654ffcaa7269542741cd00 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:46.837249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:46.837740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:46.837834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:46.857081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:46.858815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:46.889329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:46.916723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1182/2390] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:46.927357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:46.928776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:46.988096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7d3b-9ed0-4adf-bc5e-b5b0813de2b3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:46.991753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:46.992354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:46.992635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:46.992911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:47.002308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:47.003757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:47.014143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1209/2391] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:47.444082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:47.445529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:47.461140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c02ca4-fda6-416e-8733-6c888f04dc1b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:47.465787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:47.466447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:47.466732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:47.467049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] PATH_INFO: `/v3/projects/e8f4bad0871d49ef8567064e740cb54d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:47.468752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f4bad0871d49ef8567064e740cb54d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:47.471980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:47.632415 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f4bad0871d49ef8567064e740cb54d', 'request_id': 'req-7d3d4219-d3e0-4349-938a-611b4da28ead'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:47.642182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f4bad0871d49ef8567064e740cb54d', 'request_id': 'req-7d3d4219-d3e0-4349-938a-611b4da28ead'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:47.751566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f4bad0871d49ef8567064e740cb54d', 'request_id': 'req-7d3d4219-d3e0-4349-938a-611b4da28ead'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:47.765131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] The token cache is being invalidate because project e8f4bad0871d49ef8567064e740cb54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:47.770477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:47.770477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:47.770477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1183/2392] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:47 2022] DELETE /identity/v3/projects/e8f4bad0871d49ef8567064e740cb54d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:47.773079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:47.783428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dbea-3549-4b79-af3b-3c7b468b6a88 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:47.835506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:47.848879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:47.849790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:47.850265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:47.850541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] PATH_INFO: `/v3/users/abd8bd913fc24ccbb2c494f619fce2ab` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:47.851703 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd8bd913fc24ccbb2c494f619fce2ab)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:47.853681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:48.045590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd8bd913fc24ccbb2c494f619fce2ab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.046380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd8bd913fc24ccbb2c494f619fce2ab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.053553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd8bd913fc24ccbb2c494f619fce2ab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.066520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd8bd913fc24ccbb2c494f619fce2ab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.133679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd8bd913fc24ccbb2c494f619fce2ab'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.145084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1210/2393] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:47 2022] DELETE /identity/v3/users/abd8bd913fc24ccbb2c494f619fce2ab => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:48.663113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:48.664727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:48.684059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4219-d3e0-4349-938a-611b4da28ead admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:48.779375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:48.781061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:48.781460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:48.782118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] PATH_INFO: `/v3/projects/2502bc8d6a394baf9f2fb444f988ad7d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:48.783313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2502bc8d6a394baf9f2fb444f988ad7d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:48.785508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:48.894401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2502bc8d6a394baf9f2fb444f988ad7d', 'request_id': 'req-5c8ec4e0-896d-4e7b-a212-40de526b43f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.902179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2502bc8d6a394baf9f2fb444f988ad7d', 'request_id': 'req-5c8ec4e0-896d-4e7b-a212-40de526b43f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.962392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2502bc8d6a394baf9f2fb444f988ad7d', 'request_id': 'req-5c8ec4e0-896d-4e7b-a212-40de526b43f5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.964017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:48.976237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] The token cache is being invalidate because project 2502bc8d6a394baf9f2fb444f988ad7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:48.976606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.977272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:48.978843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1184/2394] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:48 2022] DELETE /identity/v3/projects/2502bc8d6a394baf9f2fb444f988ad7d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:48.983136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:48.985404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:48.999886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb175-199d-4a6b-a3f6-7677b3abdd8f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:49.088517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:49.090279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:49.100630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:49.101604 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:49.102262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:49.102749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] PATH_INFO: `/v3/users/024f728aa50c46d9adcd2de9e6dadb3a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:49.104309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=024f728aa50c46d9adcd2de9e6dadb3a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:49.106502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:49.173462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ec4e0-896d-4e7b-a212-40de526b43f5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:49.179361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:49.179969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:49.180252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:49.180526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:49.182388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:49.254815 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:49.256619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:49.268881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1185/2395] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:11:49.301500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024f728aa50c46d9adcd2de9e6dadb3a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:49.302244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024f728aa50c46d9adcd2de9e6dadb3a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:49.310540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024f728aa50c46d9adcd2de9e6dadb3a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:49.323772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024f728aa50c46d9adcd2de9e6dadb3a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:49.325433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:49.391695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1483141-d4a4-4f09-ad54-45b2fca91aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024f728aa50c46d9adcd2de9e6dadb3a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:49.399302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1211/2396] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:48 2022] DELETE /identity/v3/users/024f728aa50c46d9adcd2de9e6dadb3a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:49.969511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:49.971182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:49.986875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a724-fe93-4b26-a250-5c02c0c1ecb8 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:50.116976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:50.118261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.118753 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.119198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] PATH_INFO: `/v3/projects/ee3df6f266784ff292e9417fe6745667` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.121745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3df6f266784ff292e9417fe6745667)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:50.124829 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:50.304574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:50.311798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3df6f266784ff292e9417fe6745667', 'request_id': 'req-80d95476-4be9-4025-875f-9bc222fa8191'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:50.320391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3df6f266784ff292e9417fe6745667', 'request_id': 'req-80d95476-4be9-4025-875f-9bc222fa8191'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:50.396872 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3df6f266784ff292e9417fe6745667', 'request_id': 'req-80d95476-4be9-4025-875f-9bc222fa8191'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:50.409606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] The token cache is being invalidate because project ee3df6f266784ff292e9417fe6745667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:50.409933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:50.410613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-80d95476-4be9-4025-875f-9bc222fa8191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:50.412386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1186/2397] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:49 2022] DELETE /identity/v3/projects/ee3df6f266784ff292e9417fe6745667 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:50.417303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.417886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.417886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.441634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:50.443125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:50.528059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1212/2398] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:50.596794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.599963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.599963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.620968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:50.622612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:50.632379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1187/2399] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:50.636856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:50.647757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4622f-45c9-48ed-9dd5-84a0537c9760 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:50.654382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:50.655536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.656109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.656388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.657063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:11:50.657372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:50.659221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:50.673190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1213/2400] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:11:50.678188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:50.693011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770dc1-0026-4162-b10e-8c49d938777f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:50.694714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:50.695354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.695628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.695901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.696587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:50.698559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:50.801742 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1188/2401] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:50 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:11:50.803022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:50.814225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc14f6-6c30-48df-88ac-bdba995e4c0b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:50.885475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:50.886108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.886386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.886706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.887332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:50.890076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:50.970713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1214/2402] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:50 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:11:50.975294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:50.987263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee9c9-5ef8-43ce-8aee-2e507a9c2b87 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:50.992559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:50.993245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:50.996930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:50.996930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:50.996930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:50.996930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:51.013883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1189/2403] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:51.016112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:51.026546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba267b-c0e7-4c7e-aa83-ef0cba0dac28 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:51.031254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0c1b-3f40-413d-a201-73a108f847db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:51.031860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0c1b-3f40-413d-a201-73a108f847db admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.032268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0c1b-3f40-413d-a201-73a108f847db admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.032546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0c1b-3f40-413d-a201-73a108f847db admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.033184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa0c1b-3f40-413d-a201-73a108f847db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:51.034858 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa0c1b-3f40-413d-a201-73a108f847db admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:51.051431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1215/2404] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:51.058635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:51.080277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fe0c6-7c4b-4e07-a8d0-4d35b1cb6c08 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:51.086973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:51.088017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.088402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.088793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] PATH_INFO: `/v3/projects/fcb556cad98d4748bd0f15f669e5479f/users/37fc9dec2d534f3a99594ebebaa7b8c4/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.106783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb556cad98d4748bd0f15f669e5479f, user_id=37fc9dec2d534f3a99594ebebaa7b8c4, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:51.112352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:51.192852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1190/2405] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:51 2022] PUT /identity/v3/projects/fcb556cad98d4748bd0f15f669e5479f/users/37fc9dec2d534f3a99594ebebaa7b8c4/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:51.204556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.204830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.205108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.240588 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] MFA Rules not processed for user `37fc9dec2d534f3a99594ebebaa7b8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:51.242762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:51.296241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:51.337787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1216/2406] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:51.343346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:51.422526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b9f10-4377-47d5-ad5c-41676fc308ff admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:51.428213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:51.428847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.429515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.429515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.430150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:51.432306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:51.618718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1191/2407] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:51.622967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:51.644261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06487e-ef90-4499-8549-50cd8d8d5ec6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:51.757136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:51.757784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.758100 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.758372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.759014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:51.761017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:51.877941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1217/2408] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:51 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:51.879893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:51.899473 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0f79e-5e66-4bd1-9327-553f156d5495 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:51.904091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:51.905870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.905870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.906106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.906888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:51.908641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:51.930129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1192/2409] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:51.938767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:51.974591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca5ca4-edd6-4d76-86d0-963a96814259 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:51.980239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338276f-abad-42f3-85c6-50a42eef4aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:51.981620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338276f-abad-42f3-85c6-50a42eef4aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:51.982142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338276f-abad-42f3-85c6-50a42eef4aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:51.982581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338276f-abad-42f3-85c6-50a42eef4aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:51.984279 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338276f-abad-42f3-85c6-50a42eef4aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:51.986641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338276f-abad-42f3-85c6-50a42eef4aa2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:52.002487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1218/2410] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:52.006948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:52.022641 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bc833-81f1-4003-9467-fa960c9d8d9e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:52.028569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:52.030706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:52.030706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:52.030706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] PATH_INFO: `/v3/projects/a884d7f1965546d490e3e5acff16c1ea/users/b918703f9b6845d4908033e536395c51/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:52.050344 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a884d7f1965546d490e3e5acff16c1ea, user_id=b918703f9b6845d4908033e536395c51, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:52.053881 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:52.192518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1193/2411] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:52 2022] PUT /identity/v3/projects/a884d7f1965546d490e3e5acff16c1ea/users/b918703f9b6845d4908033e536395c51/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:52.203939 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:52.205098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:52.205098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:52.239647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] MFA Rules not processed for user `b918703f9b6845d4908033e536395c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:52.240911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:52.368693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1219/2412] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:11:52.370919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:52.401840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:52.454916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72d68b-c953-4926-8f33-70672bee0805 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:52.467798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:52.468676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:52.469150 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:52.470075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:52.470737 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:52.474190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:52.612043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1194/2413] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:11:52 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:52.617321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:52.631274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7d75d-f86a-4062-aba1-ef78a77eb2e5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:52.696794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:52.713059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:52.713059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:52.713059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:52.713059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:52.716055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:52.716055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:52.804118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1220/2414] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:11:52 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:11:52.808244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:52.831460 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5670e9-1c20-4bb8-8887-e7a76e67fc0e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:52.840690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:52.843242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:52.844869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:52.844869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:52.846374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:52.849540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:52.869657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:52.871931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1195/2415] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:11:52.887705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0cc26-c08a-4bbd-a393-dbf338cd1dd1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:52.902812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:52.903442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:52.903743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:52.909021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] PATH_INFO: `/v3/projects/3d52f4e35eaa493d8a6abb04306aa1ed/users/dd555bcb91c146e8b67661ba018fd882/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:52.934104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d52f4e35eaa493d8a6abb04306aa1ed, user_id=dd555bcb91c146e8b67661ba018fd882, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:52.939464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:53.012937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1221/2416] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:52 2022] PUT /identity/v3/projects/3d52f4e35eaa493d8a6abb04306aa1ed/users/dd555bcb91c146e8b67661ba018fd882/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:53.022068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:53.032711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a67c46-430d-4ff1-b06e-68b83ead2e32 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:53.148806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c915b8-26e9-42da-8365-84ed1c4f5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:53.149580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c915b8-26e9-42da-8365-84ed1c4f5b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:53.150118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c915b8-26e9-42da-8365-84ed1c4f5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:53.150470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c915b8-26e9-42da-8365-84ed1c4f5b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:53.152137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c915b8-26e9-42da-8365-84ed1c4f5b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:53.152912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c915b8-26e9-42da-8365-84ed1c4f5b67 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:53.185984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1196/2417] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:11:53.187853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:53.199469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d54a4-26d7-409a-9d46-107b81b34836 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:53.205283 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:53.206009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:53.206295 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:53.211403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] PATH_INFO: `/v3/projects/3d52f4e35eaa493d8a6abb04306aa1ed/users/dd555bcb91c146e8b67661ba018fd882/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:53.211403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d52f4e35eaa493d8a6abb04306aa1ed, user_id=dd555bcb91c146e8b67661ba018fd882, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:53.211618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:53.234869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1222/2418] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:11:53 2022] PUT /identity/v3/projects/3d52f4e35eaa493d8a6abb04306aa1ed/users/dd555bcb91c146e8b67661ba018fd882/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:11:53.237073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:53.237570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:53.238032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:53.270731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] MFA Rules not processed for user `dd555bcb91c146e8b67661ba018fd882`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:53.272130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:53.368940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1197/2419] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:53.383041 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:53.385270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:53.448199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab257-cecd-4ad4-ac9a-8d6bfc919bc1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:53.457400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:53.457580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:53.457804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:53.458110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:53.518751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:53.520234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:53.543491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1223/2420] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:56.303644 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:56.311650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:56.321107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:56.374078 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902563c-e3e0-49b6-bea3-b67714243a28 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:56.377793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:56.378405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:56.378682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:56.378960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:56.380820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:56.478854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:56.481607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:56.493988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1198/2421] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:57.940230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:57.949405 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555f04-34f0-4783-b725-ab79bb527b59 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:57.954185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5ff5-e4e2-49f5-bf15-fe21b458722b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:57.954885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5ff5-e4e2-49f5-bf15-fe21b458722b service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:57.955153 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5ff5-e4e2-49f5-bf15-fe21b458722b service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:57.955464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5ff5-e4e2-49f5-bf15-fe21b458722b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:58.038619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5ff5-e4e2-49f5-bf15-fe21b458722b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:58.040098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5ff5-e4e2-49f5-bf15-fe21b458722b service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:58.045663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:58.051271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1224/2422] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:12:00.146555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:00.149984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:00.174438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5e6ee-c652-4058-87e0-33dbe00c0422 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:00.181301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:00.182173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:00.182716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:00.183252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:00.197094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:00.203796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:00.211106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1199/2423] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:12:01.572738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:01.572738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:01.572738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:01.601465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:01.602772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:01.695151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1225/2424] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:12:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:01.733708 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:01.735478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:01.813800 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086179a9-137e-4221-b717-1409785f5bdb service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:01.820229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339336a-42ed-448d-bb70-a8ce412a31e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:01.821172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339336a-42ed-448d-bb70-a8ce412a31e5 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:01.821468 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339336a-42ed-448d-bb70-a8ce412a31e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:01.821975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339336a-42ed-448d-bb70-a8ce412a31e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:01.832338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339336a-42ed-448d-bb70-a8ce412a31e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:01.834087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339336a-42ed-448d-bb70-a8ce412a31e5 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:01.842777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1200/2425] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:12:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:12:06.341423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:06.417747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3abaa-0edc-4377-a4d0-c770d8229acf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:06.422389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:06.427701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:06.430131 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:06.430834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] PATH_INFO: `/v3/users/37fc9dec2d534f3a99594ebebaa7b8c4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:06.433176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fc9dec2d534f3a99594ebebaa7b8c4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:06.435297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:06.632745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fc9dec2d534f3a99594ebebaa7b8c4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:06.633953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fc9dec2d534f3a99594ebebaa7b8c4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:06.644536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fc9dec2d534f3a99594ebebaa7b8c4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:06.703306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fc9dec2d534f3a99594ebebaa7b8c4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:06.796924 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fc9dec2d534f3a99594ebebaa7b8c4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:06.804320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1226/2426] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:12:06 2022] DELETE /identity/v3/users/37fc9dec2d534f3a99594ebebaa7b8c4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:06.808776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:06.809289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:06.809393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:06.833331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:06.834707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:06.872506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:06.903208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1201/2427] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:06.913532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:06.920451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:06.947296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:06.996904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baae472-1d97-433d-9766-13951c41470e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:07.001078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:07.001693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:07.002001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:07.002275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:07.012083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:07.013531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:07.025454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1227/2428] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:12:07.479722 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:07.487253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:07.497393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cda57-fa9a-4027-bf04-2b227a5dd268 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:07.502026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:07.502833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:07.503115 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:07.503394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] PATH_INFO: `/v3/projects/fcb556cad98d4748bd0f15f669e5479f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:07.504741 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb556cad98d4748bd0f15f669e5479f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:07.506712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:07.578690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:07.580159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:07.594790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6da20-f650-4fe9-b98a-af9358b26452 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:07.601506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:07.602194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:07.602481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:07.602757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] PATH_INFO: `/v3/users/6c69d403816c441fbd215f85f2df854b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:07.603930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c69d403816c441fbd215f85f2df854b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:07.605974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:07.642901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb556cad98d4748bd0f15f669e5479f', 'request_id': 'req-784be157-b3e7-4294-8e7c-050b548b86cb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.650834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb556cad98d4748bd0f15f669e5479f', 'request_id': 'req-784be157-b3e7-4294-8e7c-050b548b86cb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.774178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb556cad98d4748bd0f15f669e5479f', 'request_id': 'req-784be157-b3e7-4294-8e7c-050b548b86cb'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.793820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] The token cache is being invalidate because project fcb556cad98d4748bd0f15f669e5479f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:12:07.794205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.794839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.799308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1202/2429] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:12:07 2022] DELETE /identity/v3/projects/fcb556cad98d4748bd0f15f669e5479f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:07.801159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:07.803282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:07.847261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c69d403816c441fbd215f85f2df854b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.848191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c69d403816c441fbd215f85f2df854b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.860623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c69d403816c441fbd215f85f2df854b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.880440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c69d403816c441fbd215f85f2df854b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.890366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be157-b3e7-4294-8e7c-050b548b86cb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:07.897293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:07.898209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:07.898384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:07.898620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] PATH_INFO: `/v3/users/b918703f9b6845d4908033e536395c51` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:07.899844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b918703f9b6845d4908033e536395c51)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:07.901786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:07.974254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b2118d1d-a291-4017-b9fe-4907254bf6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c69d403816c441fbd215f85f2df854b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:07.985128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1228/2430] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:12:07 2022] DELETE /identity/v3/users/6c69d403816c441fbd215f85f2df854b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:07.987620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:07.988825 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:07.989234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:08.013772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:08.017682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:08.114098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b918703f9b6845d4908033e536395c51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:08.115326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b918703f9b6845d4908033e536395c51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:08.120658 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1229/2431] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:08.130073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:08.131357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b918703f9b6845d4908033e536395c51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:08.132758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:08.136445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:08.193276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:08.216908 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a8d0b-6a4f-4437-8883-c647cca4818f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:08.222710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:08.223694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:08.223854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:08.224006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:08.225966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:08.241118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:08.242596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:08.253678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1230/2432] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:12:08.282595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b918703f9b6845d4908033e536395c51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:08.283214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b918703f9b6845d4908033e536395c51'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:08.298987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1203/2433] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:12:07 2022] DELETE /identity/v3/users/b918703f9b6845d4908033e536395c51 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:12:08.936060 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:08.941990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:08.943198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:08.944097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:08.975802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a6f2-3ba4-439c-a4ba-b279ab1a3c1f service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:09.053648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6319e5-6f18-4cfc-a7b8-49d081a87e85 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:09.068614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:09.069532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:09.069680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.069904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.070190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] PATH_INFO: `/v3/projects/a884d7f1965546d490e3e5acff16c1ea` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.071151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.071401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a884d7f1965546d490e3e5acff16c1ea)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:09.071972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.072565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] PATH_INFO: `/v3/projects/e166fc9fc7b64f62a6fc7ed13096be44` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.073680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:09.074294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e166fc9fc7b64f62a6fc7ed13096be44)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:09.077936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:09.205655 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a884d7f1965546d490e3e5acff16c1ea', 'request_id': 'req-df63e167-ed83-4235-b94f-4bc00400e765'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.219376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e166fc9fc7b64f62a6fc7ed13096be44', 'request_id': 'req-9bdd6668-38a9-415e-ab06-c3411c65174f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.223612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a884d7f1965546d490e3e5acff16c1ea', 'request_id': 'req-df63e167-ed83-4235-b94f-4bc00400e765'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.229344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e166fc9fc7b64f62a6fc7ed13096be44', 'request_id': 'req-9bdd6668-38a9-415e-ab06-c3411c65174f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.293980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a884d7f1965546d490e3e5acff16c1ea', 'request_id': 'req-df63e167-ed83-4235-b94f-4bc00400e765'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.313974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] The token cache is being invalidate because project a884d7f1965546d490e3e5acff16c1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:12:09.314467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.315270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.320517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1204/2434] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:12:08 2022] DELETE /identity/v3/projects/a884d7f1965546d490e3e5acff16c1ea => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:09.321527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:09.334001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e166fc9fc7b64f62a6fc7ed13096be44', 'request_id': 'req-9bdd6668-38a9-415e-ab06-c3411c65174f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.336755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:09.352015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] The token cache is being invalidate because project e166fc9fc7b64f62a6fc7ed13096be44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:12:09.352015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.352015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9bdd6668-38a9-415e-ab06-c3411c65174f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.363914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1231/2435] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:12:08 2022] DELETE /identity/v3/projects/e166fc9fc7b64f62a6fc7ed13096be44 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:09.372095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb18bd-8dd7-46ed-aec5-dcdabe8408e1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.372500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb18bd-8dd7-46ed-aec5-dcdabe8408e1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.372827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb18bd-8dd7-46ed-aec5-dcdabe8408e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.397538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8bcb18bd-8dd7-46ed-aec5-dcdabe8408e1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:09.398953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8bcb18bd-8dd7-46ed-aec5-dcdabe8408e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:09.434306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63e167-ed83-4235-b94f-4bc00400e765 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:09.468692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:09.512039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1232/2436] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:09.519915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.520452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.521261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.543215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:09.544694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:09.548527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:09.549177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.549532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.549745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] PATH_INFO: `/v3/users/dd555bcb91c146e8b67661ba018fd882` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.551371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd555bcb91c146e8b67661ba018fd882)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:09.553339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:09.556000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1233/2437] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:09.562949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:09.580757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48547e-1882-4e98-a6b8-552661a98580 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:09.587733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:09.588471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.589357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.589754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.591006 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:12:09.591940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:09.593817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:09.596462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:09.609408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1234/2438] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:12:09.616064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:09.631289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106b477-6c25-49f5-bb62-6da0c903cef2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:09.636345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:09.637064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.637412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.637753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.638501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:09.641203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:09.731722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1235/2439] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:12:09 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:12:09.738513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:09.774000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd555bcb91c146e8b67661ba018fd882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.785795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd555bcb91c146e8b67661ba018fd882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.816066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd555bcb91c146e8b67661ba018fd882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:09.908226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c1f1-c055-47db-bac1-94743e9d106a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:09.928235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:09.928890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:09.929334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:09.929473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:09.930115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:09.932107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:10.105603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd555bcb91c146e8b67661ba018fd882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:10.105603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd555bcb91c146e8b67661ba018fd882'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:10.123188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1236/2440] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:12:09 2022] POST /identity/v3/users => generated 287 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:12:10.128979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1205/2441] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:12:09 2022] DELETE /identity/v3/users/dd555bcb91c146e8b67661ba018fd882 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:10.130660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:10.134853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:10.157221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f9f2a-0b48-406c-a8a4-289730f589d2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:10.230859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:10.330690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:10.330690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:10.330690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:10.330690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:10.330690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:10.330690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1237/2442] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:12:10.332082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:10.348108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe5e77-3d7c-4ac0-bffe-636ce351d52f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:10.354928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a155-f999-4606-922f-810a14bce707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:10.355690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a155-f999-4606-922f-810a14bce707 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:10.356054 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a155-f999-4606-922f-810a14bce707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:10.356388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a155-f999-4606-922f-810a14bce707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:10.357210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a155-f999-4606-922f-810a14bce707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:10.359041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a155-f999-4606-922f-810a14bce707 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:10.371044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1206/2443] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:12:10.381561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:10.400511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4a166-0ad8-4cde-b40b-688d6abf7865 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:10.406409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:10.407502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:10.407805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:10.408260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] PATH_INFO: `/v3/projects/f19d014d21fe42af9dfeff18dcf4145b/users/4d833aee01894c00b4e03aa8c7535399/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:10.428756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19d014d21fe42af9dfeff18dcf4145b, user_id=4d833aee01894c00b4e03aa8c7535399, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:10.431493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:10.641922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1238/2444] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:12:10 2022] PUT /identity/v3/projects/f19d014d21fe42af9dfeff18dcf4145b/users/4d833aee01894c00b4e03aa8c7535399/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:10.715087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:10.715396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:10.716222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:10.767470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] MFA Rules not processed for user `4d833aee01894c00b4e03aa8c7535399`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:10.771393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:10.857575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1207/2445] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:10.872891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:10.875767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:10.915421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:10.944942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008289c0-17ec-4085-bbbe-57812a4eb72f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:10.952315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5e2a-277f-4104-8419-8604e11111fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:10.952315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5e2a-277f-4104-8419-8604e11111fd service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:10.952315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5e2a-277f-4104-8419-8604e11111fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:10.952315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5e2a-277f-4104-8419-8604e11111fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:10.961553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5e2a-277f-4104-8419-8604e11111fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:10.963183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5e2a-277f-4104-8419-8604e11111fd service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:10.988114 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1239/2446] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:12:10.992783 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:10.994351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:11.045086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:11.138893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71c1a1-2034-4b57-8d22-3a79978b0297 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:11.145669 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:11.146504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:11.146637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:11.146909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] PATH_INFO: `/v3/projects/3d52f4e35eaa493d8a6abb04306aa1ed` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:11.148638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d52f4e35eaa493d8a6abb04306aa1ed)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:11.150692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:11.314236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d52f4e35eaa493d8a6abb04306aa1ed', 'request_id': 'req-1be71c80-87bc-417f-8975-e577fbfeafb9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:11.335915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d52f4e35eaa493d8a6abb04306aa1ed', 'request_id': 'req-1be71c80-87bc-417f-8975-e577fbfeafb9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:11.456197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d52f4e35eaa493d8a6abb04306aa1ed', 'request_id': 'req-1be71c80-87bc-417f-8975-e577fbfeafb9'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:11.476651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] The token cache is being invalidate because project 3d52f4e35eaa493d8a6abb04306aa1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:12:11.476651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:11.477916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-1be71c80-87bc-417f-8975-e577fbfeafb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:11.479660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1208/2447] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:12:10 2022] DELETE /identity/v3/projects/3d52f4e35eaa493d8a6abb04306aa1ed => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:21.049277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=11 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:21.472356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:22.360277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f3b65-3c13-4988-b2cb-9b7449a9f1be None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:22.364788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f3b65-3c13-4988-b2cb-9b7449a9f1be None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:22.364788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f3b65-3c13-4988-b2cb-9b7449a9f1be None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:22.365966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1240/2448] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:12:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:12:22.373964 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047802b5-6e48-4c35-92e6-4570c25a6947 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:22.374391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047802b5-6e48-4c35-92e6-4570c25a6947 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:22.374807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047802b5-6e48-4c35-92e6-4570c25a6947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:22.401209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-047802b5-6e48-4c35-92e6-4570c25a6947 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:22.403064 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-047802b5-6e48-4c35-92e6-4570c25a6947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:22.512153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1209/2449] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:12:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:12:22.526199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f3b65-3c13-4988-b2cb-9b7449a9f1be None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:22.528025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2b4f3b65-3c13-4988-b2cb-9b7449a9f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:22.597014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f3b65-3c13-4988-b2cb-9b7449a9f1be None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:22.601081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381eb70-9d21-4b48-9941-7b201e5aec54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:22.601704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381eb70-9d21-4b48-9941-7b201e5aec54 service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:22.602024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381eb70-9d21-4b48-9941-7b201e5aec54 service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:22.602296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381eb70-9d21-4b48-9941-7b201e5aec54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:22.614214 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381eb70-9d21-4b48-9941-7b201e5aec54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:22.616318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381eb70-9d21-4b48-9941-7b201e5aec54 service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:22.629957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1241/2450] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:12:22.903833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd6708-c7c9-40d3-a8eb-20903f8c4715 None None] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:22.904314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd6708-c7c9-40d3-a8eb-20903f8c4715 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:22.904458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd6708-c7c9-40d3-a8eb-20903f8c4715 None None] PATH_INFO: `/` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:22.905953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1210/2451] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 12:12:22.914085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafe7a-7656-4029-b487-653f3725afc3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:22.914590 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafe7a-7656-4029-b487-653f3725afc3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:22.915258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafe7a-7656-4029-b487-653f3725afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:22.951904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-18dafe7a-7656-4029-b487-653f3725afc3 None None] MFA Rules not processed for user `aa49e174aaa14829a0281441a834ef4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:22.953187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-18dafe7a-7656-4029-b487-653f3725afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:23.047896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1242/2452] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:12:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:23.061511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd6708-c7c9-40d3-a8eb-20903f8c4715 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:23.064571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-47cd6708-c7c9-40d3-a8eb-20903f8c4715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:23.080946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd6708-c7c9-40d3-a8eb-20903f8c4715 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:23.085420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edb4af-3b83-4805-b547-2916f028c6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:23.086270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb4af-3b83-4805-b547-2916f028c6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:23.086706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb4af-3b83-4805-b547-2916f028c6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:23.087480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb4af-3b83-4805-b547-2916f028c6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:23.095933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edb4af-3b83-4805-b547-2916f028c6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:23.097946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edb4af-3b83-4805-b547-2916f028c6cb service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:23.107102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1211/2453] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:12:23.209927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263356b9-f8f8-48c1-8277-6c277ee4d805 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:23.212654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263356b9-f8f8-48c1-8277-6c277ee4d805 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:23.212654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263356b9-f8f8-48c1-8277-6c277ee4d805 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:23.213092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1243/2454] 10.222.0.47 () {54 vars in 921 bytes} [Mon Oct 10 12:12:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:12:23.220445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:23.220807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:23.221232 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:23.247821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] MFA Rules not processed for user `6384fbfdbff1461594e0e4f877bc8e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:23.249432 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:23.262327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1212/2455] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Oct 10 12:12:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:23.274994 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263356b9-f8f8-48c1-8277-6c277ee4d805 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:23.289333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263356b9-f8f8-48c1-8277-6c277ee4d805 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:23.294083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aad8a-7423-417a-b5a1-584a54627e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:23.294954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aad8a-7423-417a-b5a1-584a54627e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:23.295359 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aad8a-7423-417a-b5a1-584a54627e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:23.295756 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aad8a-7423-417a-b5a1-584a54627e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:23.309228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aad8a-7423-417a-b5a1-584a54627e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:23.310869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aad8a-7423-417a-b5a1-584a54627e98 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:23.324521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1244/2456] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:12:26.882403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:26.884106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:26.965911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbd6db-5aef-40a5-8213-61f73a375980 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:26.972581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:26.973367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:26.973798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:26.974208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] PATH_INFO: `/v3/users/4d833aee01894c00b4e03aa8c7535399` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:26.975584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d833aee01894c00b4e03aa8c7535399)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:26.977709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:27.168978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d833aee01894c00b4e03aa8c7535399'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:27.169838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d833aee01894c00b4e03aa8c7535399'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:27.193679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d833aee01894c00b4e03aa8c7535399'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:27.304988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d833aee01894c00b4e03aa8c7535399'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:27.305828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d833aee01894c00b4e03aa8c7535399'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:27.308976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:27.323945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1213/2457] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:12:26 2022] DELETE /identity/v3/users/4d833aee01894c00b4e03aa8c7535399 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:12:27.330096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:27.330778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:27.331113 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:27.372522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:27.376323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:27.534010 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1245/2458] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:27.549438 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:27.551956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:27.660885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed3e9-2d29-4076-9db5-f5c2a22bf87b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:27.668759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d1742-aceb-4a75-8512-0bcfe3c5d167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:27.669472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d1742-aceb-4a75-8512-0bcfe3c5d167 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:27.670124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d1742-aceb-4a75-8512-0bcfe3c5d167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:27.670679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d1742-aceb-4a75-8512-0bcfe3c5d167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:27.687944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d1742-aceb-4a75-8512-0bcfe3c5d167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:27.690898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d1742-aceb-4a75-8512-0bcfe3c5d167 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:27.711676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1214/2459] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:12:28.375026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:28.377456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:28.414007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7901-fd6d-4e5f-b79d-97494dd91b77 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:28.422700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:28.423828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:28.424599 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:28.425656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] PATH_INFO: `/v3/projects/f19d014d21fe42af9dfeff18dcf4145b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:28.427083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19d014d21fe42af9dfeff18dcf4145b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:28.429506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:28.558626 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:28.570659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19d014d21fe42af9dfeff18dcf4145b', 'request_id': 'req-5b167f1b-6232-414c-ad3e-7ef624aef8b3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:28.580216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19d014d21fe42af9dfeff18dcf4145b', 'request_id': 'req-5b167f1b-6232-414c-ad3e-7ef624aef8b3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:28.624717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19d014d21fe42af9dfeff18dcf4145b', 'request_id': 'req-5b167f1b-6232-414c-ad3e-7ef624aef8b3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:28.637499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] The token cache is being invalidate because project f19d014d21fe42af9dfeff18dcf4145b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:12:28.637795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:28.644952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:12:28.644952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1246/2460] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:12:28 2022] DELETE /identity/v3/projects/f19d014d21fe42af9dfeff18dcf4145b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:12:28.828334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1bf96-d275-4b39-9dee-b64f84c42000 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:28.828977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1bf96-d275-4b39-9dee-b64f84c42000 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:28.829548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1bf96-d275-4b39-9dee-b64f84c42000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:28.865294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f7d1bf96-d275-4b39-9dee-b64f84c42000 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:28.866874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f7d1bf96-d275-4b39-9dee-b64f84c42000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:28.934429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1215/2461] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:12:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:12:28.947852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:28.949430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:29.038242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b167f1b-6232-414c-ad3e-7ef624aef8b3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:29.047477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:29.048460 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:29.048931 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:29.049366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:29.068585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:29.072620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:29.090344 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1247/2462] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:12:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:12:38.926435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=55 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:39.083987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=5,keystone:SELECT=43,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:54.863480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:54.864085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:54.864201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:54.889123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:12:54.890379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:54.898443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1216/2463] 10.222.0.47 () {58 vars in 967 bytes} [Mon Oct 10 12:12:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:12:54.912252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:54.924031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8e526-e067-4993-b222-5e19dec0fcbc service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:54.929803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:54.930150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:54.930312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:54.930592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:54.941157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:54.942846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:54.952542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1248/2464] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:13:04.883305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:04.955919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:13:42.362123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:13:42.363554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:13:42.424836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e306-fceb-4032-9c60-d2c70ed61cd1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:13:42.428328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:13:42.428934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:13:42.429210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:13:42.429517 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:13:42.431299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:13:42.528808 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:13:42.530319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:13:42.542388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1217/2465] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:13:43.876079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:13:43.889414 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f8f2-a48e-4c51-a149-9310e48412a9 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:13:43.893210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:13:43.893832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:13:43.894151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:13:43.894428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:13:43.896294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:13:43.911465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:13:43.912972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:13:43.926194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1249/2466] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:13:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:13:52.286912 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:13:52.288484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:13:52.303026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d023ba-08a9-48a1-8e03-38e1d632bfd3 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:13:52.309123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:13:52.309723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:13:52.310039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:13:52.310312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:13:52.312019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:13:52.376086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:13:52.377826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c268d-6533-4234-bd04-b159089e6306 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:13:52.388330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1218/2467] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:13:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:13:53.920417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:02.383111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=82 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:10.025483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:10.035304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9f056-d752-4865-a7fa-939a0679a767 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:10.039014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:10.039609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:10.039885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:10.040156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:10.042183 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:10.052300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:10.053741 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:10.062491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1250/2468] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:12.398567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:12.399180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:12.399180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:12.419688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] MFA Rules not processed for user `1416ea3d97ef4396ab8975a4d43bbdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:14:12.420941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:12.427940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1219/2469] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:14:17.223951 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:17.225525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:17.242062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45d99f-9df8-4cd4-a2e1-31dddc3deffb service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:17.247347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:17.247958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:17.248233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:17.248507 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:17.250346 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:17.313241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:17.315127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:17.325909 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1251/2470] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:19.044133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:19.065347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3ca9f-c858-479c-b8da-dd6b0f585768 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:19.074909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:19.076217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:19.076505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:19.076780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:19.078583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:19.091872 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:19.093663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bd05f-3151-4a2d-9e22-78f0e5a81ce7 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:19.105628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1220/2471] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:23.887933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:23.899964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfebd5-ac8b-41b0-b400-8574319d0d39 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:23.906485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:23.907218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:23.907598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:23.907958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:23.909781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:23.923371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:23.924970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:23.938407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1252/2472] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:29.100905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=9 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:29.378693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:29.378978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:29.379252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:29.398187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] MFA Rules not processed for user `df1f64397b6e4dbeb1f39d1a27b3da3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:14:29.399384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:29.406272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1221/2473] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:14:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:14:29.717673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:29.727469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e70ad-3bc3-44dc-a799-b3742c5eb918 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:29.731037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:29.732201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:29.732505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:29.732773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:29.734509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:29.744418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:29.746144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:29.754583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1253/2474] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:30.417933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:30.419631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:30.496556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d31ca-8d42-4daf-b34a-ca4ab69b45c8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:30.502801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:30.503412 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:30.503698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:30.504015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:30.505698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:30.517656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:30.519636 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:30.529403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1222/2475] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:39.750941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=46 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:40.525011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=35 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:14:42.106259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:14:42.122484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdda5c-8f33-43ca-aef7-e776f1ee755c service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:14:42.128991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:14:42.130372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:14:42.130372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:14:42.130372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:14:42.132074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:14:42.144775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:14:42.146394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9e16a-4c20-4d3c-8d3f-7b63d74023f4 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:14:42.157720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1254/2476] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:14:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:14:52.152744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:07.179349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:07.191871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199355-6f5b-490a-aa50-d664bdc07ce0 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:07.198162 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:07.200126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:07.200126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:07.200126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:07.201221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:07.271147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:07.273100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:07.282241 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1223/2477] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:15:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:15:17.277809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=28 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:23.252946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:23.253502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:23.253502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:23.274016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:15:23.275256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:23.282584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1255/2478] 10.222.0.47 () {58 vars in 967 bytes} [Mon Oct 10 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:15:23.473023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:23.486793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4583d-64a4-460b-a69e-1d2d874c5ae8 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:23.493094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:23.493715 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:23.494038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:23.494553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:23.503997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:23.505642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:23.516303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1224/2479] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:15:24.651071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:24.660584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36da4d3-c46e-4054-8f48-502c763db9ca None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:24.664402 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:24.664991 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:24.665268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:24.665692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:24.667504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:24.731903 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:24.733417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:24.747998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1256/2480] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:15:28.773879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:28.775429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:28.792332 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c028f2-a612-4063-945a-89a5090e860f service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:28.797840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:28.798237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:28.798518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:28.798983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:28.800772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:28.813132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:28.814824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:28.826416 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1225/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:15:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:15:32.755767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:32.757261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:32.772097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5645595-f732-4f3e-8b7c-5b4b7edb7378 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:32.777169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:32.778111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:32.778396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:32.778672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] PATH_INFO: `/v3/users/d452e82ec89e447db772b6732e963ae8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:32.779956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d452e82ec89e447db772b6732e963ae8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:32.781937 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:32.950759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd452e82ec89e447db772b6732e963ae8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:32.951472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd452e82ec89e447db772b6732e963ae8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:32.959163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd452e82ec89e447db772b6732e963ae8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:32.971444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd452e82ec89e447db772b6732e963ae8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.068052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd452e82ec89e447db772b6732e963ae8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.074784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1257/2482] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:15:32 2022] DELETE /identity/v3/users/d452e82ec89e447db772b6732e963ae8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:15:33.383293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:33.395878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d652cb-3048-49d0-ae64-d29383af4b17 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:33.456035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:33.456697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:33.456981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:33.457263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] PATH_INFO: `/v3/projects/7d9281ee0665459dae69dfa80d23bb15` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:33.458956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9281ee0665459dae69dfa80d23bb15)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:33.460885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:33.554413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9281ee0665459dae69dfa80d23bb15', 'request_id': 'req-0e57736e-d161-4481-982c-3d49c8556a19'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.560971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9281ee0665459dae69dfa80d23bb15', 'request_id': 'req-0e57736e-d161-4481-982c-3d49c8556a19'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.604763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9281ee0665459dae69dfa80d23bb15', 'request_id': 'req-0e57736e-d161-4481-982c-3d49c8556a19'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.616427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] The token cache is being invalidate because project 7d9281ee0665459dae69dfa80d23bb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:15:33.616736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.617380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.619028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1226/2483] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:15:33 2022] DELETE /identity/v3/projects/7d9281ee0665459dae69dfa80d23bb15 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:15:33.623187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:33.624719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:33.640867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088867-051a-423a-ba7e-2e00a8430057 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:33.700235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:33.700879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:33.701163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:33.701441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] PATH_INFO: `/v3/users/44090bd6173c4677b1d4e7a836c0aae1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:33.702656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44090bd6173c4677b1d4e7a836c0aae1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:33.704646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:33.706742 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:33.911669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44090bd6173c4677b1d4e7a836c0aae1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.912399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44090bd6173c4677b1d4e7a836c0aae1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.920284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44090bd6173c4677b1d4e7a836c0aae1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:33.934376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44090bd6173c4677b1d4e7a836c0aae1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.010361 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44090bd6173c4677b1d4e7a836c0aae1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.016718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1258/2484] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:15:33 2022] DELETE /identity/v3/users/44090bd6173c4677b1d4e7a836c0aae1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:15:34.251511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:34.252961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:34.266716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57736e-d161-4481-982c-3d49c8556a19 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:34.325315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:34.325998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:34.326277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:34.326550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] PATH_INFO: `/v3/projects/4d0d6f148a63413d95c15c522c942308` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:34.327656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0d6f148a63413d95c15c522c942308)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:34.329553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:34.335755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:34.468544 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0d6f148a63413d95c15c522c942308', 'request_id': 'req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.475072 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0d6f148a63413d95c15c522c942308', 'request_id': 'req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.547562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0d6f148a63413d95c15c522c942308', 'request_id': 'req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.558924 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] The token cache is being invalidate because project 4d0d6f148a63413d95c15c522c942308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:15:34.559210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.559834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:15:34.561327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1227/2485] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:15:34 2022] DELETE /identity/v3/projects/4d0d6f148a63413d95c15c522c942308 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:15:44.013038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:44.650474 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:15:57.458624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:15:57.463286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:57.526873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9da08-5b86-4e1e-9943-435ac92403c1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:15:57.579497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:15:57.580284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:15:57.580573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:15:57.581000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:15:57.582904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:15:57.651320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:15:57.651950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:15:57.662117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1259/2486] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:01.216501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:01.218093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:01.237606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d93d4-90d9-4a22-91fb-ca4c76a2f8fc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:01.245569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:01.246740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:01.247248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:01.247761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] PATH_INFO: `/v3/users/1416ea3d97ef4396ab8975a4d43bbdca` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:01.249955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1416ea3d97ef4396ab8975a4d43bbdca)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:01.253664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:01.460724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1416ea3d97ef4396ab8975a4d43bbdca'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:01.461921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1416ea3d97ef4396ab8975a4d43bbdca'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:01.478155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1416ea3d97ef4396ab8975a4d43bbdca'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:01.558860 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1416ea3d97ef4396ab8975a4d43bbdca'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:01.559504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c7f5a54f-63e6-4d23-b338-a3287c7af24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1416ea3d97ef4396ab8975a4d43bbdca'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:01.573274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1228/2487] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:01 2022] DELETE /identity/v3/users/1416ea3d97ef4396ab8975a4d43bbdca => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:01.858191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:01.869786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de70ca-58ee-4caf-ad62-e970040969ad service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:01.942433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:01.943595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:01.943876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:01.944149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] PATH_INFO: `/v3/projects/0a6b935b47fc41b7bd5f83e60ffcdb0b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:01.946544 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6b935b47fc41b7bd5f83e60ffcdb0b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:01.947524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:01.963446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:02.109692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6b935b47fc41b7bd5f83e60ffcdb0b', 'request_id': 'req-15872726-b25c-44c4-8097-e39f42191426'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:02.119832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6b935b47fc41b7bd5f83e60ffcdb0b', 'request_id': 'req-15872726-b25c-44c4-8097-e39f42191426'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:02.186990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6b935b47fc41b7bd5f83e60ffcdb0b', 'request_id': 'req-15872726-b25c-44c4-8097-e39f42191426'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:02.199234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] The token cache is being invalidate because project 0a6b935b47fc41b7bd5f83e60ffcdb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:02.199540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:02.200193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-15872726-b25c-44c4-8097-e39f42191426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:02.201715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1260/2488] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:01 2022] DELETE /identity/v3/projects/0a6b935b47fc41b7bd5f83e60ffcdb0b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:02.207659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.208173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.208462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.229903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:02.231139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:02.302223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1229/2489] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:02.310713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.311139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.311520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.332710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:02.334094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:02.342716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1261/2490] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:02.347355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:02.357370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6ab0-69f0-40ca-aa5a-203d15549e6d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:02.362226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:02.362790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.363033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.363312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.363972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:16:02.364274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:02.366434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:02.379047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1230/2491] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:16:02.387115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:02.396960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118ab9-e3fa-43ad-8fa7-a00612408f41 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:02.401880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:02.402505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.402829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.403109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.403735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:02.405649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:02.543082 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1262/2492] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:02 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:02.547418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:02.558610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d73dc-81ef-4f5b-8c28-41eebc1ad9c7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:02.620943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:02.621469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.621759 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.622065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.622711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:02.624652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:02.633440 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:02.742854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1231/2493] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:02 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:02.746834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:02.757211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173a27f-d160-4eb0-bf10-ae5f3a67b257 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:02.761973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:02.762579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.762984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.763241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.763886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:02.765492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:02.777056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1263/2494] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:02.782091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:02.793051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a44d-4bc6-47ec-aac0-5e61f8172f89 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:02.798194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcc0fb-7d3d-4eb8-bb0b-37b9b0420ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:02.798812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcc0fb-7d3d-4eb8-bb0b-37b9b0420ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.799092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcc0fb-7d3d-4eb8-bb0b-37b9b0420ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.799370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcc0fb-7d3d-4eb8-bb0b-37b9b0420ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.800019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcc0fb-7d3d-4eb8-bb0b-37b9b0420ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:02.801627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcc0fb-7d3d-4eb8-bb0b-37b9b0420ab1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:02.813695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1232/2495] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:02.818065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:02.828545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5f8a-d028-4513-b381-417d59238ba1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:02.833204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:02.833871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.834163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.834447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] PATH_INFO: `/v3/projects/0eed5d08fdea4eea948f355178b24b42/users/fd46b6ca4f614c6d8aac787a55e16c0b/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:02.850910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eed5d08fdea4eea948f355178b24b42, user_id=fd46b6ca4f614c6d8aac787a55e16c0b, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:02.853577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:02.958843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1264/2496] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:02 2022] PUT /identity/v3/projects/0eed5d08fdea4eea948f355178b24b42/users/fd46b6ca4f614c6d8aac787a55e16c0b/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:16:02.970563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:02.970859 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:02.971137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.000276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] MFA Rules not processed for user `fd46b6ca4f614c6d8aac787a55e16c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:03.001493 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:03.067247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1233/2497] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:03.071784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.142653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94d0a5-cb27-4139-a7d5-e638ed26362d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.148468 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.149106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.149415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.149681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.150425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.152397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.269637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1265/2498] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:03 2022] POST /identity/v3/projects => generated 405 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:03.274913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.295016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fc1ea-5631-438e-aa6d-9605a1a753aa None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.375155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.375768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.376051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.376325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.376972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.378947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.462996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1234/2499] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:03 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:03.469720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.481282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5250-f2f7-4344-826c-9364075e6c2f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.486217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.486845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.487126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.487406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.488068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.489865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.501404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1266/2500] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:03.506363 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.516624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d6e85-5118-4538-9547-4d9bce8f2960 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.521560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.522713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.522971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.523225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] PATH_INFO: `/v3/projects/dadd417744704a3d94a23698fb966162/users/61debcad6a59429fa97b2a0c17e4d441/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.540014 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadd417744704a3d94a23698fb966162, user_id=61debcad6a59429fa97b2a0c17e4d441, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.542748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.616221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1235/2501] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:03 2022] PUT /identity/v3/projects/dadd417744704a3d94a23698fb966162/users/61debcad6a59429fa97b2a0c17e4d441/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:03.620332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.631307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991271e-4f11-4cc2-8384-9ece4b72afdf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.635235 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:03.693785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62da61-6fd3-4517-9999-579b93dc3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.694507 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62da61-6fd3-4517-9999-579b93dc3325 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.695036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62da61-6fd3-4517-9999-579b93dc3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.695490 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62da61-6fd3-4517-9999-579b93dc3325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.697185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62da61-6fd3-4517-9999-579b93dc3325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.700463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62da61-6fd3-4517-9999-579b93dc3325 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.716206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1267/2502] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:03.721413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.733620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7115dc-54a9-407f-9d2e-9a97e42e3640 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.738617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.739295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.739578 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.739887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] PATH_INFO: `/v3/projects/dadd417744704a3d94a23698fb966162/users/61debcad6a59429fa97b2a0c17e4d441/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.742290 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadd417744704a3d94a23698fb966162, user_id=61debcad6a59429fa97b2a0c17e4d441, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.744976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.756756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1236/2503] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:03 2022] PUT /identity/v3/projects/dadd417744704a3d94a23698fb966162/users/61debcad6a59429fa97b2a0c17e4d441/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:03.767282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.767813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.767980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.797281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] MFA Rules not processed for user `61debcad6a59429fa97b2a0c17e4d441`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:03.798453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:03.868846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1268/2504] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:03.879809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:03.882168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:03.905431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:03.943929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bfa03-0212-4063-a67a-7ac73747551f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:03.947678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ebb69-6dea-4162-b4be-b172237a0a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:03.948289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ebb69-6dea-4162-b4be-b172237a0a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:03.948568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ebb69-6dea-4162-b4be-b172237a0a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:03.948842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ebb69-6dea-4162-b4be-b172237a0a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:03.958597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ebb69-6dea-4162-b4be-b172237a0a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:03.960629 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ebb69-6dea-4162-b4be-b172237a0a1a service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:03.970476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1237/2505] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:04.125914 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:04.193012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce02c3-ef99-4d0a-ac4e-0f32ff97d313 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:04.197834 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:04.198504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:04.198780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:04.199063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] PATH_INFO: `/v3/users/fd46b6ca4f614c6d8aac787a55e16c0b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:04.200264 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd46b6ca4f614c6d8aac787a55e16c0b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:04.202316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:04.377378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:04.393119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd46b6ca4f614c6d8aac787a55e16c0b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:04.394062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd46b6ca4f614c6d8aac787a55e16c0b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:04.402847 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd46b6ca4f614c6d8aac787a55e16c0b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:04.416677 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd46b6ca4f614c6d8aac787a55e16c0b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:04.484564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd46b6ca4f614c6d8aac787a55e16c0b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:04.491967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1269/2506] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:04 2022] DELETE /identity/v3/users/fd46b6ca4f614c6d8aac787a55e16c0b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:04.496802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:04.497348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:04.497348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:04.517077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:04.518396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:04.585369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1238/2507] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:16:04.597380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:04.598893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:04.668602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe182-66d3-4e64-a750-3eacf967bb3d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:04.672454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:04.673080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:04.673365 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:04.673635 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:04.683772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:04.685287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:04.696536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1270/2508] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:05.202556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:05.204515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:05.220441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ced2a-99bd-4f7b-acdd-a75a29c60b49 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:05.225370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:05.226071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:05.226356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:05.226694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] PATH_INFO: `/v3/projects/0eed5d08fdea4eea948f355178b24b42` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:05.227785 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eed5d08fdea4eea948f355178b24b42)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:05.229725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:05.342383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eed5d08fdea4eea948f355178b24b42', 'request_id': 'req-67624975-94b3-40da-899d-70006adf6980'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.349330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eed5d08fdea4eea948f355178b24b42', 'request_id': 'req-67624975-94b3-40da-899d-70006adf6980'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.415921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eed5d08fdea4eea948f355178b24b42', 'request_id': 'req-67624975-94b3-40da-899d-70006adf6980'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.427558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] The token cache is being invalidate because project 0eed5d08fdea4eea948f355178b24b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:05.433016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.433016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.433016 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1239/2509] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:05 2022] DELETE /identity/v3/projects/0eed5d08fdea4eea948f355178b24b42 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:05.434745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:05.445911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63285-25a3-4e7c-b25c-6521cc9756d0 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:05.507763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:05.508419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:05.508692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:05.508965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] PATH_INFO: `/v3/users/61debcad6a59429fa97b2a0c17e4d441` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:05.510234 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61debcad6a59429fa97b2a0c17e4d441)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:05.512196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:05.710015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61debcad6a59429fa97b2a0c17e4d441'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.710508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61debcad6a59429fa97b2a0c17e4d441'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.715403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:05.718689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61debcad6a59429fa97b2a0c17e4d441'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.731029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61debcad6a59429fa97b2a0c17e4d441'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.798538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-872e6f72-1515-4f40-be7a-c2cdc3b84642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61debcad6a59429fa97b2a0c17e4d441'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:05.805559 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1271/2510] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:05 2022] DELETE /identity/v3/users/61debcad6a59429fa97b2a0c17e4d441 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:06.263281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:06.264811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:06.280731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67624975-94b3-40da-899d-70006adf6980 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:06.333307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:06.347178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:06.347824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:06.348109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:06.348388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] PATH_INFO: `/v3/projects/dadd417744704a3d94a23698fb966162` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:06.349526 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadd417744704a3d94a23698fb966162)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:06.352124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:06.470452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadd417744704a3d94a23698fb966162', 'request_id': 'req-62548f05-3e20-4293-ac81-a566fe4ac36a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:06.477210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadd417744704a3d94a23698fb966162', 'request_id': 'req-62548f05-3e20-4293-ac81-a566fe4ac36a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:06.541646 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadd417744704a3d94a23698fb966162', 'request_id': 'req-62548f05-3e20-4293-ac81-a566fe4ac36a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:06.554448 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] The token cache is being invalidate because project dadd417744704a3d94a23698fb966162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:06.554747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:06.555421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-62548f05-3e20-4293-ac81-a566fe4ac36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:06.557030 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1240/2511] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:06 2022] DELETE /identity/v3/projects/dadd417744704a3d94a23698fb966162 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:06.562398 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:06.562995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:06.562995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:06.584052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:06.585971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:06.650415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1272/2512] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:06.658444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:06.658729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:06.659013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:06.682279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:06.683542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:06.691883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1241/2513] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:16:06.697376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:06.712050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e165e-029e-4f44-b6f7-323a4454b9d7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:06.716751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:06.717381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:06.717673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:06.717970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:06.718879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:16:06.719177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:06.720789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:06.733092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1273/2514] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:16:06.737686 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:06.747851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b842f36-689c-4eee-8a92-825e5dca4875 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:06.753006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:06.753620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:06.753933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:06.754212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:06.754864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:06.757475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:06.846566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1242/2515] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:06 2022] POST /identity/v3/projects => generated 355 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:06.850902 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:06.861498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d172-8c23-4a64-a97e-877ff9d2416b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:06.923524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:06.924133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:06.924412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:06.924686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:06.925320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:06.927284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.004670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1274/2516] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:06 2022] POST /identity/v3/users => generated 278 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:07.009706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.022160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268a7d-1734-46e9-b580-1a300c5ee407 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.025368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.026024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.026302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.026590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.027221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.028831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.039772 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1243/2517] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:16:07.044542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.056138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710cefd-555b-4dd2-8bd3-45021d3fec28 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.061648 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1fea5-46fd-4696-be34-e8aecc878acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.062305 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1fea5-46fd-4696-be34-e8aecc878acc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.062596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1fea5-46fd-4696-be34-e8aecc878acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.062855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1fea5-46fd-4696-be34-e8aecc878acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.063496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1fea5-46fd-4696-be34-e8aecc878acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.065106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1fea5-46fd-4696-be34-e8aecc878acc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.077883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1275/2518] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:16:07.082052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.092768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9eb7c-80c6-47d5-93a3-ca9408468ae3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.099338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.099338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.099338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.099338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] PATH_INFO: `/v3/projects/799775f67e4d4bbe9b97e813be87bfa1/users/6928a0b20f954682ab8103ff5404e208/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.115327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799775f67e4d4bbe9b97e813be87bfa1, user_id=6928a0b20f954682ab8103ff5404e208, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.118671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.188013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1244/2519] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:07 2022] PUT /identity/v3/projects/799775f67e4d4bbe9b97e813be87bfa1/users/6928a0b20f954682ab8103ff5404e208/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:07.199858 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cab9b-b873-4641-afbb-843935455780 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.200343 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cab9b-b873-4641-afbb-843935455780 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.200655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cab9b-b873-4641-afbb-843935455780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.231192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c57cab9b-b873-4641-afbb-843935455780 None None] MFA Rules not processed for user `6928a0b20f954682ab8103ff5404e208`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:07.232408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c57cab9b-b873-4641-afbb-843935455780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:07.257707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:07.299557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1276/2520] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:16:07.304961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.370734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712a892-eb21-4d79-8585-b5060daada40 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.375657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.376285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.376567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.376844 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.377485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.379481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.461752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:07.470774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1245/2521] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:07 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:07.474953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cab9b-b873-4641-afbb-843935455780 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.487454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cab9b-b873-4641-afbb-843935455780 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.552242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.552849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.553130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.553406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.554080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.556233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.656575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1277/2522] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:07 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:16:07.660533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.673556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fe1c3-c70d-4741-8301-9532d28aaccc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.678787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.679435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.679703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.679982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.680666 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.682456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.693827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1246/2523] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:07.698445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.708787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c06d-1dc9-49cd-bbfd-673f350f44a2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.714662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.715320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.715605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.715878 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] PATH_INFO: `/v3/projects/5afcfbdcdb054583b776163089c0a009/users/d81b71ebd2434f54878b110b4eb23f0c/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.734014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afcfbdcdb054583b776163089c0a009, user_id=d81b71ebd2434f54878b110b4eb23f0c, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.736713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.850135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1278/2524] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:07 2022] PUT /identity/v3/projects/5afcfbdcdb054583b776163089c0a009/users/d81b71ebd2434f54878b110b4eb23f0c/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:07.855292 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.871587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289b365-a40c-47c3-8143-b609bc6a0255 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.933243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907bbcf-5583-4179-ab3f-a1005b194eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.933865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907bbcf-5583-4179-ab3f-a1005b194eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.934123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907bbcf-5583-4179-ab3f-a1005b194eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.934402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907bbcf-5583-4179-ab3f-a1005b194eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.935049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907bbcf-5583-4179-ab3f-a1005b194eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.936689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907bbcf-5583-4179-ab3f-a1005b194eaa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.948346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1247/2525] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:16:07.952812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:07.964740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708da09-132b-47e7-a01f-899d11678281 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:07.969975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:07.970649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:07.970933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:07.971210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] PATH_INFO: `/v3/projects/5afcfbdcdb054583b776163089c0a009/users/d81b71ebd2434f54878b110b4eb23f0c/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:07.973197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afcfbdcdb054583b776163089c0a009, user_id=d81b71ebd2434f54878b110b4eb23f0c, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:07.975915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:07.988822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1279/2526] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:07 2022] PUT /identity/v3/projects/5afcfbdcdb054583b776163089c0a009/users/d81b71ebd2434f54878b110b4eb23f0c/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:16:08.001242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:08.001530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:08.001811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:08.034862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] MFA Rules not processed for user `d81b71ebd2434f54878b110b4eb23f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:08.036112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:08.131105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1248/2527] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:16:08.144707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:08.146527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:08.212314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde231-752c-4c3a-b4e6-5755ba1c7adc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:08.216393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:08.217017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:08.217302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:08.217581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:08.228366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:08.229919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:08.240913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1280/2528] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:08.459331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:08.470130 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7fde7-bced-47ff-b560-4cf94b2fb1a7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:08.473940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a75d8-e086-4853-b422-5cc9b15d6b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:08.474642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a75d8-e086-4853-b422-5cc9b15d6b86 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:08.474925 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a75d8-e086-4853-b422-5cc9b15d6b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:08.475202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a75d8-e086-4853-b422-5cc9b15d6b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:08.555560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a75d8-e086-4853-b422-5cc9b15d6b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:08.557021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a75d8-e086-4853-b422-5cc9b15d6b86 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:08.566445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1249/2529] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:18.235917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:18.562197 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:22.703248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:22.704693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:22.873439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5436-fbf3-40cf-bd2c-e0c280931802 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:22.879576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:22.880194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:22.880470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:22.880743 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:22.883093 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:22.896177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:22.898031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:22.917363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1281/2530] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:16:26.609996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:26.610558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:26.610856 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:26.631291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] MFA Rules not processed for user `9c9e8d7ae50941ba9e76138aaf604d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:26.633026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:26.695202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1250/2531] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:27.023854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:27.025378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:27.093190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bded38f-3bb0-4f88-afe8-1d3990010180 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:27.100788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:27.101403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:27.101679 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:27.101989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:27.103786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:27.114515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:27.117431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad529308-f608-4288-a9e3-48906fbee67e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:27.125340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1282/2532] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:16:29.920583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:30.023236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0153a8-b1dd-491f-a802-dca1e05623d3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:30.030433 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:30.031283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:30.031756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:30.032554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] PATH_INFO: `/v3/users/6928a0b20f954682ab8103ff5404e208` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:30.035370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6928a0b20f954682ab8103ff5404e208)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:30.037714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:30.265251 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6928a0b20f954682ab8103ff5404e208'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:30.265973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6928a0b20f954682ab8103ff5404e208'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:30.278839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6928a0b20f954682ab8103ff5404e208'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:30.363262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6928a0b20f954682ab8103ff5404e208'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:30.363917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6928a0b20f954682ab8103ff5404e208'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:30.378603 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1251/2533] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:29 2022] DELETE /identity/v3/users/6928a0b20f954682ab8103ff5404e208 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:16:30.383352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:30.383860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:30.384345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:30.423294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:30.427102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:30.428287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:30.496839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1283/2534] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:30.507208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:30.509100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:30.519295 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:30.569774 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5557fb9-06f3-49b5-81f3-5f52b3dd710b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:30.573442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:30.574075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:30.574358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:30.574634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:30.585794 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:30.587272 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:30.601621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1252/2535] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:31.035816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:31.036669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:31.050650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9245a0-a528-4eaa-a437-b467973710bd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:31.063096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:31.069061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:31.069328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:31.069764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] PATH_INFO: `/v3/projects/799775f67e4d4bbe9b97e813be87bfa1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:31.086607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799775f67e4d4bbe9b97e813be87bfa1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:31.086607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:31.213042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799775f67e4d4bbe9b97e813be87bfa1', 'request_id': 'req-6468ebf1-599b-494d-bf4e-19b84164ec40'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.222978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799775f67e4d4bbe9b97e813be87bfa1', 'request_id': 'req-6468ebf1-599b-494d-bf4e-19b84164ec40'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.318308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799775f67e4d4bbe9b97e813be87bfa1', 'request_id': 'req-6468ebf1-599b-494d-bf4e-19b84164ec40'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.330573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] The token cache is being invalidate because project 799775f67e4d4bbe9b97e813be87bfa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:31.330860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.331506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.332978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1284/2536] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:31 2022] DELETE /identity/v3/projects/799775f67e4d4bbe9b97e813be87bfa1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:31.337803 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:31.348109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dc8e7-30a7-4b58-8d89-877565e944c1 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:31.406357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:31.406995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:31.407277 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:31.407550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] PATH_INFO: `/v3/users/d81b71ebd2434f54878b110b4eb23f0c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:31.408679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81b71ebd2434f54878b110b4eb23f0c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:31.410697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:31.600934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81b71ebd2434f54878b110b4eb23f0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.601613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81b71ebd2434f54878b110b4eb23f0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.615302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81b71ebd2434f54878b110b4eb23f0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.700674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81b71ebd2434f54878b110b4eb23f0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.701403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0cf3fce9-75f4-4ab2-bbde-4a90dfd8abc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81b71ebd2434f54878b110b4eb23f0c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:31.714515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1253/2537] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:31 2022] DELETE /identity/v3/users/d81b71ebd2434f54878b110b4eb23f0c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:32.298659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:32.301334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:32.348899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468ebf1-599b-494d-bf4e-19b84164ec40 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:32.409454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:32.410206 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:32.410540 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:32.410863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] PATH_INFO: `/v3/projects/5afcfbdcdb054583b776163089c0a009` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:32.412231 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afcfbdcdb054583b776163089c0a009)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:32.414813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:32.541155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:32.555434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afcfbdcdb054583b776163089c0a009', 'request_id': 'req-fa77c510-ee66-4652-bc36-6441dfc4f770'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:32.563286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afcfbdcdb054583b776163089c0a009', 'request_id': 'req-fa77c510-ee66-4652-bc36-6441dfc4f770'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:32.633064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afcfbdcdb054583b776163089c0a009', 'request_id': 'req-fa77c510-ee66-4652-bc36-6441dfc4f770'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:32.644479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] The token cache is being invalidate because project 5afcfbdcdb054583b776163089c0a009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:32.644889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:32.645538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa77c510-ee66-4652-bc36-6441dfc4f770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:32.647040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1285/2538] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:32 2022] DELETE /identity/v3/projects/5afcfbdcdb054583b776163089c0a009 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:32.652562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:32.653112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:32.653457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:32.706622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:32.718009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:32.719278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:32.781261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1254/2539] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:32.789811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:32.790128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:32.790407 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:32.809990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:32.811200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:32.819883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1286/2540] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:32.824093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:32.834308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b5082-ae23-435b-ae71-0b91e28dcd07 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:32.839706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:32.840311 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:32.840597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:32.840877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:32.841574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:16:32.841908 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:32.843795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:32.859457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1255/2541] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:16:32.863245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:32.869953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2cb66-6701-4cb8-9b86-f4ef89a7c813 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:32.874712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:32.875301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:32.875583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:32.875855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:32.876568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:32.878513 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:32.964938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1287/2542] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:32 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:32.969721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:32.979835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e04f2-cf3e-41e5-881f-a4cbaa362cf7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.039274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.039885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.040174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.040589 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.041236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.043201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.136471 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1256/2543] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:32 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:33.140621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.151083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af21d-8640-4e50-b1e6-43ff6dd6c1e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.155633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.156220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.156712 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.156848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.157476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.159087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.169248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1288/2544] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:33.173328 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.183929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538bb9d-eb01-4a18-867b-0dfd0acb628a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.189567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4f90-39e9-4eac-b24d-e36849cbe31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.190209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4f90-39e9-4eac-b24d-e36849cbe31e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.190488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4f90-39e9-4eac-b24d-e36849cbe31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.196293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4f90-39e9-4eac-b24d-e36849cbe31e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.196293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa4f90-39e9-4eac-b24d-e36849cbe31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.196293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa4f90-39e9-4eac-b24d-e36849cbe31e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.203571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1257/2545] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:33.208068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.218323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd9dbe-62d1-40cb-9dd5-d2e3b1d2bacf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.222796 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.223433 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.223713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.223984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] PATH_INFO: `/v3/projects/b30e627ff753437db3fb435ee7e4c83f/users/fcc4c9eb7b3e4f1d846627c5fe4d899c/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.238221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30e627ff753437db3fb435ee7e4c83f, user_id=fcc4c9eb7b3e4f1d846627c5fe4d899c, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.240876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.307454 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1289/2546] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:33 2022] PUT /identity/v3/projects/b30e627ff753437db3fb435ee7e4c83f/users/fcc4c9eb7b3e4f1d846627c5fe4d899c/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:16:33.317944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.318231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.318512 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.348625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] MFA Rules not processed for user `fcc4c9eb7b3e4f1d846627c5fe4d899c`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:33.350019 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:33.413974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:33.421041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1258/2547] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:33.422391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.491134 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85b38c-3171-4580-a19d-76759d295a0c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.496845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.497486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.497765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.498072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.498701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.500631 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.599645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1290/2548] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:33 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:33.604368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.615225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30b18-d43b-4089-935e-2aecd9daf5d3 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.674528 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.675261 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.675413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.675690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.676325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.678312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.786502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1259/2549] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:33 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:16:33.791057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.802107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365e3a2-345c-4547-978d-5784b5ffae15 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.806997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.807613 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.807896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.808170 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.808817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.810467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.825385 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1291/2550] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:16:33.827122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.838038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e01e7d-b7ad-45f7-9d12-c400601cee26 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.842945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:33.843599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:33.843874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:33.844152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] PATH_INFO: `/v3/projects/ff3b536369a04f629aa2cbd0301b8eb5/users/3f2b7875ffe04b8a8d074bb5579695b4/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:33.860000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3b536369a04f629aa2cbd0301b8eb5, user_id=3f2b7875ffe04b8a8d074bb5579695b4, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:33.862707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:33.935083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1260/2551] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:33 2022] PUT /identity/v3/projects/ff3b536369a04f629aa2cbd0301b8eb5/users/3f2b7875ffe04b8a8d074bb5579695b4/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:33.939072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:33.949291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57295e-deba-431e-b7a2-228a8497c846 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:33.979058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:34.005296 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e924073-ec49-42f2-b350-f267b048b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:34.005933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924073-ec49-42f2-b350-f267b048b711 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:34.006216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924073-ec49-42f2-b350-f267b048b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:34.006492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924073-ec49-42f2-b350-f267b048b711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:34.007129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e924073-ec49-42f2-b350-f267b048b711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:34.008713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e924073-ec49-42f2-b350-f267b048b711 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:34.018459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1292/2552] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:34.023100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:34.033335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e051e-9ad9-4277-8b67-b582b8cfc594 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:34.038068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:34.039209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:34.039488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:34.039758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] PATH_INFO: `/v3/projects/ff3b536369a04f629aa2cbd0301b8eb5/users/3f2b7875ffe04b8a8d074bb5579695b4/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:34.041633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3b536369a04f629aa2cbd0301b8eb5, user_id=3f2b7875ffe04b8a8d074bb5579695b4, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:34.044300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:34.055123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1261/2553] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:34 2022] PUT /identity/v3/projects/ff3b536369a04f629aa2cbd0301b8eb5/users/3f2b7875ffe04b8a8d074bb5579695b4/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:34.065585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:34.065924 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:34.066207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:34.094312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] MFA Rules not processed for user `3f2b7875ffe04b8a8d074bb5579695b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:34.095534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:34.163880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1293/2554] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:34.174698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:34.176434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:34.234633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906338e-e1ca-41c0-a573-29d5a4106bf1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:34.238469 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:34.239301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:34.239620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:34.239897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:34.295812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:34.297160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:34.306082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1262/2555] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:40.852713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:40.873140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1e959-dcc3-47b0-b2b8-7b936e95d748 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:40.876888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40689bc9-5f1e-4c93-afc8-f8b3afb03a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:40.877484 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40689bc9-5f1e-4c93-afc8-f8b3afb03a45 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:40.877766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40689bc9-5f1e-4c93-afc8-f8b3afb03a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:40.878072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40689bc9-5f1e-4c93-afc8-f8b3afb03a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:40.887482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40689bc9-5f1e-4c93-afc8-f8b3afb03a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:40.888910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40689bc9-5f1e-4c93-afc8-f8b3afb03a45 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:40.898410 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1294/2556] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:16:44.302027 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:46.790683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:46.859746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a381da9-b7a5-4e2f-9f14-71e822230fb2 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:46.864595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:46.865249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:46.865522 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:46.865793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] PATH_INFO: `/v3/users/fcc4c9eb7b3e4f1d846627c5fe4d899c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:46.867063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc4c9eb7b3e4f1d846627c5fe4d899c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:46.869221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:47.112563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc4c9eb7b3e4f1d846627c5fe4d899c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:47.115625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc4c9eb7b3e4f1d846627c5fe4d899c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:47.129329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc4c9eb7b3e4f1d846627c5fe4d899c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:47.226348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc4c9eb7b3e4f1d846627c5fe4d899c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:47.226978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc4c9eb7b3e4f1d846627c5fe4d899c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:47.240704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1263/2557] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:46 2022] DELETE /identity/v3/users/fcc4c9eb7b3e4f1d846627c5fe4d899c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:47.245184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:47.245757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:47.245891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:47.272123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:47.273435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:47.342896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1295/2558] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:47.352746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:47.354264 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:47.446393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf2592-d2d6-4d3d-8f8f-ce332f1e497b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:47.452735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:47.454063 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:47.454586 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:47.455103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:47.473967 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:47.476867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:47.493529 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1264/2559] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:47.944629 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:47.946104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:47.959276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d7eb7-8663-4c8a-83f4-94dc364a7456 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:47.964130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:47.971397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:47.971397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:47.971397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] PATH_INFO: `/v3/projects/b30e627ff753437db3fb435ee7e4c83f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:47.971397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30e627ff753437db3fb435ee7e4c83f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:47.971397 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:48.056209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:48.072916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30e627ff753437db3fb435ee7e4c83f', 'request_id': 'req-fc5333d1-bf06-41dc-9bac-a7d291df450f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.079291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30e627ff753437db3fb435ee7e4c83f', 'request_id': 'req-fc5333d1-bf06-41dc-9bac-a7d291df450f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.153058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30e627ff753437db3fb435ee7e4c83f', 'request_id': 'req-fc5333d1-bf06-41dc-9bac-a7d291df450f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.165969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] The token cache is being invalidate because project b30e627ff753437db3fb435ee7e4c83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:48.166262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.166862 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.168967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1296/2560] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:47 2022] DELETE /identity/v3/projects/b30e627ff753437db3fb435ee7e4c83f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:48.173379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:48.178868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:48.184369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce34b4-8b2b-4ada-bbfc-4a8a5c7740d2 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:48.245021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:48.245657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:48.245982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:48.246260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] PATH_INFO: `/v3/users/3f2b7875ffe04b8a8d074bb5579695b4` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:48.247434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2b7875ffe04b8a8d074bb5579695b4)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:48.249369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:48.445572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2b7875ffe04b8a8d074bb5579695b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.445572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2b7875ffe04b8a8d074bb5579695b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.464411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2b7875ffe04b8a8d074bb5579695b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.541071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2b7875ffe04b8a8d074bb5579695b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.541721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-34cab1c6-96cf-449e-8f90-d544f1325b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2b7875ffe04b8a8d074bb5579695b4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:48.556505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1265/2561] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:16:48 2022] DELETE /identity/v3/users/3f2b7875ffe04b8a8d074bb5579695b4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:48.976574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:48.978140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:48.994596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5333d1-bf06-41dc-9bac-a7d291df450f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.053251 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.053918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.054204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.054569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] PATH_INFO: `/v3/projects/ff3b536369a04f629aa2cbd0301b8eb5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.055595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3b536369a04f629aa2cbd0301b8eb5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.057531 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:49.172505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3b536369a04f629aa2cbd0301b8eb5', 'request_id': 'req-be390306-5115-4a73-947d-993f39e6d70b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:49.180312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3b536369a04f629aa2cbd0301b8eb5', 'request_id': 'req-be390306-5115-4a73-947d-993f39e6d70b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:49.278497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3b536369a04f629aa2cbd0301b8eb5', 'request_id': 'req-be390306-5115-4a73-947d-993f39e6d70b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:49.293888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] The token cache is being invalidate because project ff3b536369a04f629aa2cbd0301b8eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:16:49.294386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:49.295193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be390306-5115-4a73-947d-993f39e6d70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:16:49.296860 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1297/2562] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:16:48 2022] DELETE /identity/v3/projects/ff3b536369a04f629aa2cbd0301b8eb5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:49.302939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.303825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.303825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.328913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:49.330208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:49.396505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1266/2563] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:49.406136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.406422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.406699 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.429270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:49.430541 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:49.439160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1298/2564] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:49.443223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:49.458590 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02b47c-6b78-4234-affe-895168088da8 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.466214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.467159 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.467919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.468371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.469372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:16:49.469792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.471624 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:49.485933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1267/2565] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:16:49.490681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:49.500389 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb03ae4-bffc-4cc0-bc39-9316343566e6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.505178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.505793 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.506106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.506379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.507014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.508928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:49.651706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1299/2566] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:16:49 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:16:49.656639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:49.667425 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499009d5-0907-4744-9f6c-18f93ed76beb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.673514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:49.733378 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.734022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.734308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.734584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.735242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.737201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:49.816349 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1268/2567] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:16:49 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:16:49.820666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:49.831767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc3f2-8d42-4cff-90e9-a89ef9cc3c61 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.836371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.837119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.837247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.837500 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.838595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.840378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:49.851502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1300/2568] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:49.855782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:49.866031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1364942-3384-463e-a79a-7353141b8128 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.870718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8882dda-dff2-4028-92df-abee01e65875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.871374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8882dda-dff2-4028-92df-abee01e65875 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.871658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8882dda-dff2-4028-92df-abee01e65875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.871932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8882dda-dff2-4028-92df-abee01e65875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.872569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8882dda-dff2-4028-92df-abee01e65875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.874212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8882dda-dff2-4028-92df-abee01e65875 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:49.885390 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1269/2569] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:16:49.890174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:49.897053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:16:49.904419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678baf5-16ef-4744-aa8c-c753113b4fab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:49.911419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:49.912222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:49.912503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:49.912778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] PATH_INFO: `/v3/projects/6087435f53ea4590b60b04b7f76818d0/users/fda4f215e50d45128ad8c88c48dc47cc/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:49.930271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6087435f53ea4590b60b04b7f76818d0, user_id=fda4f215e50d45128ad8c88c48dc47cc, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:49.932970 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:50.016577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1301/2570] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:16:49 2022] PUT /identity/v3/projects/6087435f53ea4590b60b04b7f76818d0/users/fda4f215e50d45128ad8c88c48dc47cc/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:16:50.037008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51c24a-48a9-4659-96fc-66bb16508aef None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:50.037420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51c24a-48a9-4659-96fc-66bb16508aef None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:50.037798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51c24a-48a9-4659-96fc-66bb16508aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:50.069796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-1e51c24a-48a9-4659-96fc-66bb16508aef None None] MFA Rules not processed for user `fda4f215e50d45128ad8c88c48dc47cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:50.071021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1e51c24a-48a9-4659-96fc-66bb16508aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:50.143252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1270/2571] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:50.154869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:50.156821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:50.216728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8b7ba-7fc4-470d-ba79-136d822682e2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:50.220721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:50.221313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:50.221595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:50.221896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:50.231122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:50.232650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:50.241985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1302/2572] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:16:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:16:51.042142 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:51.042937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:51.043222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:51.077098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:16:51.078364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:51.159422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1271/2573] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:16:51.352828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:16:51.355656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:16:51.432859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246af48-8bae-4684-9c83-ed006126860f service glance] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:16:51.438852 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed6e7-42b5-470f-8a94-1f1d061da08c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:16:51.440230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed6e7-42b5-470f-8a94-1f1d061da08c service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:16:51.440230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed6e7-42b5-470f-8a94-1f1d061da08c service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:16:51.440230 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed6e7-42b5-470f-8a94-1f1d061da08c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:16:51.449237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed6e7-42b5-470f-8a94-1f1d061da08c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:16:51.450884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed6e7-42b5-470f-8a94-1f1d061da08c service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:16:51.461200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1303/2574] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:16:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:17:01.151916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:01.456925 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:13.099398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:13.167835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112ffe-0789-4841-8835-b48e50b1ddd7 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:13.172570 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:13.173204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:13.173567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:13.173874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] PATH_INFO: `/v3/users/fda4f215e50d45128ad8c88c48dc47cc` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:13.175101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda4f215e50d45128ad8c88c48dc47cc)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:13.177051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:13.442226 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda4f215e50d45128ad8c88c48dc47cc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:13.442911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda4f215e50d45128ad8c88c48dc47cc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:13.464733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda4f215e50d45128ad8c88c48dc47cc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:13.580731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda4f215e50d45128ad8c88c48dc47cc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:13.581367 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda4f215e50d45128ad8c88c48dc47cc'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:13.596185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1272/2575] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:13 2022] DELETE /identity/v3/users/fda4f215e50d45128ad8c88c48dc47cc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:13.600568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:13.601003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:13.601116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:13.621355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:13.622841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:13.683597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1304/2576] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:17:13.693152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:13.694604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:13.755716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3df1e-4c08-4b77-ab08-54b2b415721b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:13.759576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b446d6-fc19-48dc-91f3-4d64bdd08360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:13.760561 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b446d6-fc19-48dc-91f3-4d64bdd08360 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:13.761450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b446d6-fc19-48dc-91f3-4d64bdd08360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:13.761734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b446d6-fc19-48dc-91f3-4d64bdd08360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:13.771405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b446d6-fc19-48dc-91f3-4d64bdd08360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:13.772870 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b446d6-fc19-48dc-91f3-4d64bdd08360 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:13.783548 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1273/2577] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:17:14.239502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:14.241077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:14.254254 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7432-1e6c-4e08-9d22-7031711cc195 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:14.259408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:14.260262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.260529 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.260843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] PATH_INFO: `/v3/projects/6087435f53ea4590b60b04b7f76818d0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.262986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6087435f53ea4590b60b04b7f76818d0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:14.265033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:14.321435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.321943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.330780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.344075 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:14.345301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:14.362404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:14.403451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1274/2578] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:17:14.406471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6087435f53ea4590b60b04b7f76818d0', 'request_id': 'req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:14.413267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6087435f53ea4590b60b04b7f76818d0', 'request_id': 'req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:14.416492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:14.417963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:14.490276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8212451-6816-4981-a3dc-5f21a5c35828 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:14.535435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6087435f53ea4590b60b04b7f76818d0', 'request_id': 'req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:14.558764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] The token cache is being invalidate because project 6087435f53ea4590b60b04b7f76818d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:14.559300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:14.560371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c0d418a1-42b3-40bc-81f7-8c48e22b37f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:14.561935 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:14.562559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.562838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.563049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1305/2579] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:14 2022] DELETE /identity/v3/projects/6087435f53ea4590b60b04b7f76818d0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:14.563229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.565040 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:14.568949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.569466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.569988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.603944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:14.606692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:14.633306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:14.634965 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfe714-443d-46d0-b7ea-c8c3209ac98b service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:14.644077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1275/2580] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:17:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 12:17:14.704616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1306/2581] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:14.713816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.714132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.714409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.735820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:14.741946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:14.744970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1276/2582] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:14.749916 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:14.759954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c862956-df82-49cd-bf7d-ff34afe48d31 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:14.764859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:14.765479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.765773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.766054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.766709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:17:14.767261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:14.768652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:14.788493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1307/2583] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:17:14.790308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:14.811214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:14.822090 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451481b7-7bd3-4f46-bf96-ca54411d9889 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:14.841426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:14.846790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:14.847841 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:14.848712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:14.850259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:14.854775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:14.976441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1277/2584] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:17:14 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:17:14.981380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:14.997031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21c27d-c179-496a-ba10-a8684a45202c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.006220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:15.075849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.076533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.076833 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.077155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.078088 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.082835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:15.186083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1308/2585] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:17:14 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:17:15.187434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:15.200923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9f0b-30b3-4bd8-83ef-d2f7a48020db admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.207028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.207959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.209166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.209449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.210175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.213348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:15.227896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1278/2586] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:15.233560 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:15.258226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935c706-3c4a-496c-9cfc-fe00bc47c4a8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.258671 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb762f3-2fae-459e-9d1c-6d87969b7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.259042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb762f3-2fae-459e-9d1c-6d87969b7df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.259266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb762f3-2fae-459e-9d1c-6d87969b7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.259542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb762f3-2fae-459e-9d1c-6d87969b7df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.260369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb762f3-2fae-459e-9d1c-6d87969b7df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.266138 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb762f3-2fae-459e-9d1c-6d87969b7df2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:15.284425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1309/2587] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:15.285921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:15.300550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d719ad-0e28-4d07-b994-50f7643955ad admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.306773 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.307674 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.308684 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.308975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] PATH_INFO: `/v3/projects/6d2d59516ac041ebaf61462cc89f5b3c/users/79dadd0dafe3400cba3ac168060c0dc8/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.333225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2d59516ac041ebaf61462cc89f5b3c, user_id=79dadd0dafe3400cba3ac168060c0dc8, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.336458 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:15.432675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1279/2588] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:17:15 2022] PUT /identity/v3/projects/6d2d59516ac041ebaf61462cc89f5b3c/users/79dadd0dafe3400cba3ac168060c0dc8/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:15.445516 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.446076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.446563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.500282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] MFA Rules not processed for user `79dadd0dafe3400cba3ac168060c0dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:15.501642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:15.600812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1310/2589] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:15.605494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:15.678868 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19443f81-79f9-47b1-84a2-d15479b07654 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.684520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.685147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.685435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.685716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.686394 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.688389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:15.782676 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1280/2590] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:17:15 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:17:15.786578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:15.797874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd3c6b-3db4-4aac-8ff5-2afe90a89158 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.858875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.859476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.859695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.859921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.860646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.862567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:15.959808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1311/2591] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:17:15 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:17:15.963626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:15.974547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f56f2-8ad8-4932-aa20-6d30cc06b0dd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:15.980101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:15.980987 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:15.981501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:15.981933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:15.982609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:15.984293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.002168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1281/2592] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:16.006315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.020685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad82b4f-85e7-4c50-b4db-d981fa74e527 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:16.026068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837d6dc-9fc9-4dcd-880e-4197dbbd8b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:16.026778 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837d6dc-9fc9-4dcd-880e-4197dbbd8b16 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.027128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837d6dc-9fc9-4dcd-880e-4197dbbd8b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.027417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837d6dc-9fc9-4dcd-880e-4197dbbd8b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.028103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837d6dc-9fc9-4dcd-880e-4197dbbd8b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:16.029713 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837d6dc-9fc9-4dcd-880e-4197dbbd8b16 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.037097 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:16.043388 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1312/2593] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:17:16.047873 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.059562 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b64c-5fd2-4c94-b86a-16a4493cfeaf admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:16.065519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:16.066234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.066520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.066806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] PATH_INFO: `/v3/projects/1f04729c9c264381a15a74014fe35add/users/05d8ade344b64790844dc49069b4298e/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.089139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f04729c9c264381a15a74014fe35add, user_id=05d8ade344b64790844dc49069b4298e, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:16.093181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.170651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1282/2594] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:17:16 2022] PUT /identity/v3/projects/1f04729c9c264381a15a74014fe35add/users/05d8ade344b64790844dc49069b4298e/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:16.181022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.181339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.181618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.213519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] MFA Rules not processed for user `05d8ade344b64790844dc49069b4298e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:16.215506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:16.288643 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1313/2595] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:17:16.293878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.374813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:16.380113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96a3c1-2657-4a38-8bf1-66c4f930b5b5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:16.385404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:16.387006 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.387227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.387667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.388334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:16.390499 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.475952 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1283/2596] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:17:16 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:17:16.481054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.493400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfeae9-da76-4526-962f-64b853191736 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:16.572246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:16.573109 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.574003 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.574668 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.575645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:16.578044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.694090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1314/2597] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:17:16 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:17:16.699270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.711183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226066af-9742-497a-8583-17b63048b4bd admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:16.719957 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:16.725065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.725065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.725065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.725065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:16.725065 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.741005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.745138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1284/2598] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:17:16.754690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932b044-cdb6-47ee-9d72-c5d7de5e01a9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:16.759801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:16.760487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:16.761718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:16.762084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] PATH_INFO: `/v3/projects/8f96d97c2fbb4642af4e5eccc30a49fd/users/74f2b5a961314a4fb7f388bbef2f6327/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:16.783618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f96d97c2fbb4642af4e5eccc30a49fd, user_id=74f2b5a961314a4fb7f388bbef2f6327, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:16.786575 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:16.952715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1315/2599] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:17:16 2022] PUT /identity/v3/projects/8f96d97c2fbb4642af4e5eccc30a49fd/users/74f2b5a961314a4fb7f388bbef2f6327/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:16.956950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:16.968862 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1115ba6-aed7-4183-b9de-b994ab5e3167 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:17.171769 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d74b3e-517d-43c9-aaf9-582dec000acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:17.172428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d74b3e-517d-43c9-aaf9-582dec000acb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:17.172709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d74b3e-517d-43c9-aaf9-582dec000acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:17.172979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d74b3e-517d-43c9-aaf9-582dec000acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:17.173637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d74b3e-517d-43c9-aaf9-582dec000acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:17.175338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d74b3e-517d-43c9-aaf9-582dec000acb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:17.188175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1285/2600] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:17.192771 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:17.204964 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49412b-dd4e-4f32-a7bd-da3dc769696c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:17.212351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:17.213026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:17.213517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:17.213721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] PATH_INFO: `/v3/projects/8f96d97c2fbb4642af4e5eccc30a49fd/users/74f2b5a961314a4fb7f388bbef2f6327/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:17.216133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f96d97c2fbb4642af4e5eccc30a49fd, user_id=74f2b5a961314a4fb7f388bbef2f6327, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:17.219545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:17.249881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1316/2601] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:17:17 2022] PUT /identity/v3/projects/8f96d97c2fbb4642af4e5eccc30a49fd/users/74f2b5a961314a4fb7f388bbef2f6327/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:17.308945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:17.308945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:17.308945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:17.341353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] MFA Rules not processed for user `74f2b5a961314a4fb7f388bbef2f6327`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:17.348648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:17.439632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1286/2602] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:17.453448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:17.455371 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:17.511547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:17.538236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc72f-f3c7-4539-9e8f-ecd676154aa5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:17.542766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:17.543303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:17.543579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:17.543849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:17.609923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:17.611395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:17.622539 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1317/2603] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:19.720136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:19.721673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:19.737426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a061a-14cc-4c22-a273-2125ddbf02bd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:19.741726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:19.742385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:19.742673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:19.742941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:19.806931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:19.823778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:19.826698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:19.845566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1287/2604] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:17:21.598095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:21.614015 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d73c-103b-491e-92ba-4c7fa1133f31 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:21.633203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:21.633893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:21.634208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:21.634487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:21.647021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:21.649720 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:21.670013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1318/2605] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:24.106068 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:24.109608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:24.185748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bb16c-3236-4180-8ad1-2f739d71997a service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:24.189724 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:24.190399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:24.190777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:24.191170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:24.193335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:24.262560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:24.264201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9a9e2-e443-4636-bc74-110cd9c5b877 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:24.273975 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1288/2606] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:27.948447 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:28.012304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f66a37-e031-4268-b3c3-19ba55ee63c8 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:28.018547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:28.018757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:28.018993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:28.019265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] PATH_INFO: `/v3/users/79dadd0dafe3400cba3ac168060c0dc8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:28.020430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dadd0dafe3400cba3ac168060c0dc8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:28.022499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:29.025663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dadd0dafe3400cba3ac168060c0dc8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.026337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dadd0dafe3400cba3ac168060c0dc8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.034549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dadd0dafe3400cba3ac168060c0dc8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.045697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:29.046919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dadd0dafe3400cba3ac168060c0dc8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.106488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dadd0dafe3400cba3ac168060c0dc8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.113981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1319/2607] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:27 2022] DELETE /identity/v3/users/79dadd0dafe3400cba3ac168060c0dc8 => generated 0 bytes in 1167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:29.119289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:29.119840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:29.119840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:29.140073 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:29.144599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:29.210138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1289/2608] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:29.220832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:29.225151 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:29.291570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d23f6-33ba-4a62-9703-25af9ef49446 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:29.296005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:29.296198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:29.296439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:29.296653 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:29.307547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:29.309670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:29.321487 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1320/2609] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:29.730198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:29.732249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:29.750119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84848e30-f6b7-4dd2-bdc2-79d4e1f60d2c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:29.750119 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:29.750422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:29.750647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:29.750920 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] PATH_INFO: `/v3/projects/6d2d59516ac041ebaf61462cc89f5b3c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:29.752210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2d59516ac041ebaf61462cc89f5b3c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:29.754145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:29.850280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:29.856239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2d59516ac041ebaf61462cc89f5b3c', 'request_id': 'req-dcf7e254-7cd3-4001-bc49-a8450de40897'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.863168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2d59516ac041ebaf61462cc89f5b3c', 'request_id': 'req-dcf7e254-7cd3-4001-bc49-a8450de40897'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.920327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2d59516ac041ebaf61462cc89f5b3c', 'request_id': 'req-dcf7e254-7cd3-4001-bc49-a8450de40897'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.935664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] The token cache is being invalidate because project 6d2d59516ac041ebaf61462cc89f5b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:29.936094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.937417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:29.939305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1290/2610] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:29 2022] DELETE /identity/v3/projects/6d2d59516ac041ebaf61462cc89f5b3c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:29.943476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:29.955008 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6321-7714-4679-a297-bc73725ca34e service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:30.145269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:30.145928 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:30.146331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:30.146607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] PATH_INFO: `/v3/users/05d8ade344b64790844dc49069b4298e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:30.147877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d8ade344b64790844dc49069b4298e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:30.149842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:30.313577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d8ade344b64790844dc49069b4298e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:30.314200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d8ade344b64790844dc49069b4298e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:30.321053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d8ade344b64790844dc49069b4298e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:30.333408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d8ade344b64790844dc49069b4298e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:30.396152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d8ade344b64790844dc49069b4298e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:30.402499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1321/2611] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:29 2022] DELETE /identity/v3/users/05d8ade344b64790844dc49069b4298e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:30.879351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:30.879351 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:30.893568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e254-7cd3-4001-bc49-a8450de40897 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:30.954383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:30.954921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:30.955200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:30.955472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] PATH_INFO: `/v3/projects/1f04729c9c264381a15a74014fe35add` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:30.956584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f04729c9c264381a15a74014fe35add)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:30.958514 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:31.095921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f04729c9c264381a15a74014fe35add', 'request_id': 'req-ec215370-9946-42d7-8ca0-18835c023e7c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.108285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f04729c9c264381a15a74014fe35add', 'request_id': 'req-ec215370-9946-42d7-8ca0-18835c023e7c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.197648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f04729c9c264381a15a74014fe35add', 'request_id': 'req-ec215370-9946-42d7-8ca0-18835c023e7c'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.210207 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] The token cache is being invalidate because project 1f04729c9c264381a15a74014fe35add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:31.210494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.220604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.220604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1291/2612] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:30 2022] DELETE /identity/v3/projects/1f04729c9c264381a15a74014fe35add => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:31.221056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:31.221056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:31.235202 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5315491-2475-4025-97df-81b978528ecd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:31.244196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:31.312143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:31.312904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:31.313281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:31.313654 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] PATH_INFO: `/v3/users/74f2b5a961314a4fb7f388bbef2f6327` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:31.315057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f2b5a961314a4fb7f388bbef2f6327)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:31.317125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:31.521807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f2b5a961314a4fb7f388bbef2f6327'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.522492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f2b5a961314a4fb7f388bbef2f6327'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.529932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f2b5a961314a4fb7f388bbef2f6327'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.543534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f2b5a961314a4fb7f388bbef2f6327'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.619195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cbe2f784-2fba-41eb-a2d3-0223226763f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f2b5a961314a4fb7f388bbef2f6327'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:31.629401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1322/2613] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:31 2022] DELETE /identity/v3/users/74f2b5a961314a4fb7f388bbef2f6327 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:32.153033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:32.160350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:32.169919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215370-9946-42d7-8ca0-18835c023e7c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:32.227062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:32.227683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.227960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.228231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] PATH_INFO: `/v3/projects/8f96d97c2fbb4642af4e5eccc30a49fd` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.229368 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f96d97c2fbb4642af4e5eccc30a49fd)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:32.231319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:32.233326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:32.340648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f96d97c2fbb4642af4e5eccc30a49fd', 'request_id': 'req-0a2b22cb-141f-40ca-80aa-eb1b0818798d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:32.347972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f96d97c2fbb4642af4e5eccc30a49fd', 'request_id': 'req-0a2b22cb-141f-40ca-80aa-eb1b0818798d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:32.442757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f96d97c2fbb4642af4e5eccc30a49fd', 'request_id': 'req-0a2b22cb-141f-40ca-80aa-eb1b0818798d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:32.462826 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] The token cache is being invalidate because project 8f96d97c2fbb4642af4e5eccc30a49fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:32.463263 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:32.463928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0a2b22cb-141f-40ca-80aa-eb1b0818798d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:32.468545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1292/2614] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:32 2022] DELETE /identity/v3/projects/8f96d97c2fbb4642af4e5eccc30a49fd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:32.473258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.473816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.473816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.494944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:32.498789 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:32.563667 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1323/2615] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:32.571177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703631-eca9-40de-9062-035ef99cd963 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.571479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703631-eca9-40de-9062-035ef99cd963 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.571751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59703631-eca9-40de-9062-035ef99cd963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.593227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-59703631-eca9-40de-9062-035ef99cd963 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:32.594459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-59703631-eca9-40de-9062-035ef99cd963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:32.602293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1293/2616] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:32.606501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:32.616291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec326-298d-4822-8c83-473290f55c21 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:32.620846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:32.623396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.623396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.623396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.624099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:17:32.624506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:32.626181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:32.638831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1324/2617] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:17:32.643620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59703631-eca9-40de-9062-035ef99cd963 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:32.652963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59703631-eca9-40de-9062-035ef99cd963 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:32.658318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:32.658919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.659992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.659992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.660152 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:32.662062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:32.768437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1294/2618] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:17:32 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:17:32.769506 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:32.780147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82147310-33d7-4623-8e7f-6d56feddc902 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:32.792352 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:32.837692 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:32.838324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.838607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.838877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.839497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:32.841429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:32.946289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1325/2619] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:17:32 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:17:32.951481 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:32.962947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c5bb1-fa78-446a-b5fe-29c280060473 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:32.967916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:32.972376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:32.972376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:32.972376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:32.972376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:32.972376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:32.984252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1295/2620] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:32.985719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:32.996396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d384a8-6feb-4c76-9693-2e02a0e867df admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:33.002157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2758ed7-8a49-4902-adc9-a0027f62ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:33.002788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2758ed7-8a49-4902-adc9-a0027f62ff0a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.003106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2758ed7-8a49-4902-adc9-a0027f62ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.003416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2758ed7-8a49-4902-adc9-a0027f62ff0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.004089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2758ed7-8a49-4902-adc9-a0027f62ff0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:33.005766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2758ed7-8a49-4902-adc9-a0027f62ff0a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:33.016864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1326/2621] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:33.021360 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:33.032613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7697ced-6a60-47ff-9e26-1f18b6ce8771 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:33.037288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:33.037962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.038245 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.038519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] PATH_INFO: `/v3/projects/d796c017b49d48f7ae9aa4ccd99511ea/users/3f903a1970ea45b3b4489d812b310e47/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.053077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796c017b49d48f7ae9aa4ccd99511ea, user_id=3f903a1970ea45b3b4489d812b310e47, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:33.055992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:33.146380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1296/2622] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:17:33 2022] PUT /identity/v3/projects/d796c017b49d48f7ae9aa4ccd99511ea/users/3f903a1970ea45b3b4489d812b310e47/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:33.158226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.158574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.158881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.189618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] MFA Rules not processed for user `3f903a1970ea45b3b4489d812b310e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:33.190774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:33.261426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1327/2623] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:33.272672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:33.274537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:33.335396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d12835-63eb-42df-9f99-2ca966d9e34c admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:33.339066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade28d-279c-4393-83c8-8791593dda57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:33.339667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade28d-279c-4393-83c8-8791593dda57 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.339945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade28d-279c-4393-83c8-8791593dda57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.340217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade28d-279c-4393-83c8-8791593dda57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.348711 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade28d-279c-4393-83c8-8791593dda57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:33.350209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade28d-279c-4393-83c8-8791593dda57 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:33.359421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1297/2624] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:17:33.384568 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:33.447216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff38fe-74de-471f-96b9-0934ad8d9cab None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:33.451936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:33.452569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.452851 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.453126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] PATH_INFO: `/v3/users/3f903a1970ea45b3b4489d812b310e47` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.454294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f903a1970ea45b3b4489d812b310e47)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:33.456275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:33.587944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:33.697961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.698262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.698543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.705839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f903a1970ea45b3b4489d812b310e47'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:33.706510 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f903a1970ea45b3b4489d812b310e47'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:33.717200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f903a1970ea45b3b4489d812b310e47'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:33.724204 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:33.725431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:33.737627 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f903a1970ea45b3b4489d812b310e47'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:33.758792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:33.786437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1298/2625] 10.222.0.47 () {58 vars in 967 bytes} [Mon Oct 10 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:17:33.800700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:33.802109 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:33.820332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2afbc2b2-f22c-461e-adc4-bb48941348c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f903a1970ea45b3b4489d812b310e47'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:33.828054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1328/2626] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:33 2022] DELETE /identity/v3/users/3f903a1970ea45b3b4489d812b310e47 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:33.832125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.832477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.832890 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.855762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:33.857602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:33.878690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b50b44-d6d5-4378-99d4-4f8d16617924 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:33.921863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1329/2627] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:17:33.931620 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:33.933087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:33.945822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff931f40-ace5-4a92-95ab-215bb063b730 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:33.946385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff931f40-ace5-4a92-95ab-215bb063b730 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.946671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff931f40-ace5-4a92-95ab-215bb063b730 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.946953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff931f40-ace5-4a92-95ab-215bb063b730 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:33.990652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22cdc-bbb3-4302-b77e-7ae7962533d4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:33.994406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:33.995007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:33.995285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:33.995555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:34.005411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:34.005795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff931f40-ace5-4a92-95ab-215bb063b730 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:34.010733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:34.010855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff931f40-ace5-4a92-95ab-215bb063b730 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:34.017619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1330/2628] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:34.018971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1299/2629] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 12:17:34.433550 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:34.435533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:34.451664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00318e30-ca3c-42ba-b9d7-5221c4747339 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:34.458009 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:34.459325 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:34.459556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:34.459830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] PATH_INFO: `/v3/projects/d796c017b49d48f7ae9aa4ccd99511ea` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:34.461040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d796c017b49d48f7ae9aa4ccd99511ea)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:34.465404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:34.618367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:34.622555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd796c017b49d48f7ae9aa4ccd99511ea', 'request_id': 'req-bf8461ae-ea04-4052-90f1-c4752e61fb8b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:34.628832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd796c017b49d48f7ae9aa4ccd99511ea', 'request_id': 'req-bf8461ae-ea04-4052-90f1-c4752e61fb8b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:34.729965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd796c017b49d48f7ae9aa4ccd99511ea', 'request_id': 'req-bf8461ae-ea04-4052-90f1-c4752e61fb8b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:34.743976 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] The token cache is being invalidate because project d796c017b49d48f7ae9aa4ccd99511ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:34.744448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:34.745411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bf8461ae-ea04-4052-90f1-c4752e61fb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:34.748217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1331/2630] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:34 2022] DELETE /identity/v3/projects/d796c017b49d48f7ae9aa4ccd99511ea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:34.755178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:34.755664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:34.755768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:34.777061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:34.778335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:34.794725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:34.850632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1300/2631] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:34.859181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:34.859471 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:34.859767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:34.880719 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:34.882077 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:34.893988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1332/2632] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:34.894882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:34.907178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399c90d-8d81-4be9-a1f9-9929076f4543 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:34.913171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:34.913942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:34.914282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:34.914702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:34.915566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:17:34.915937 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:34.917835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:34.933614 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1301/2633] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:17:34.938923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:34.948647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af292-db9e-463a-8ec5-35e7c54c0e35 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:34.958954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:34.958954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:34.958954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:34.958954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:34.960382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:34.960382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.125886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1333/2634] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:17:34 2022] POST /identity/v3/projects => generated 397 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:17:35.129417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:35.140333 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd237-f61e-41a8-8fe5-39a2977864b7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:35.202945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:35.203693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.204587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.204587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.204763 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:35.206682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.333490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1302/2635] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:17:35 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:17:35.335218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:35.351152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27c08-0f4a-4d6b-914f-dec9f49e313b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:35.353702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:35.355422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:35.356139 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:35.357495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.357777 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.358079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.358723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:35.360307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.371177 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1334/2636] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:17:35.375126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:35.385192 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750974b4-0834-4fa1-873c-6a60f06b85c2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:35.390466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:35.391052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.393758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.393758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.393758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:35.394089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.404582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1335/2637] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:17:35.408880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:35.420686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fd0f-0b92-4363-8e04-060996dd0ffc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:35.425582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc911a-75c3-43a1-b78f-3f231cc8b0d3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:35.426596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:35.427288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.427563 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.427846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] PATH_INFO: `/v3/projects/0aa892d53f8f4798a6fc0ad63e91cce8/users/8029352449b6440f93d879e40126042f/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.430284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:35.431012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.431293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.431567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.433443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:35.443980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa892d53f8f4798a6fc0ad63e91cce8, user_id=8029352449b6440f93d879e40126042f, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:35.446749 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.446974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:35.448452 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd2035-33dc-4aa2-8575-027838900b91 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.459315 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1303/2638] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:35.565334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1336/2639] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:17:35 2022] PUT /identity/v3/projects/0aa892d53f8f4798a6fc0ad63e91cce8/users/8029352449b6440f93d879e40126042f/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:35.576441 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.576726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.577003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.608607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] MFA Rules not processed for user `8029352449b6440f93d879e40126042f`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:35.609838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:35.639158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:35.679051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1304/2640] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:17:35.691200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:35.693053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:35.753277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74304a-46ff-403b-8c18-466633b5c3aa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:35.757024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:35.757633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:35.757938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:35.758215 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:35.767609 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:35.769034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:35.778025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1337/2641] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:17:39.016766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:39.018909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:39.091821 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f33c2-285e-4f12-b297-a42a7889795b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:39.096901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:39.097538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:39.097825 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:39.098140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:39.099874 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:39.111283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:39.112801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bcef1-5a61-448b-9bda-256cd283f23d service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:39.131084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1305/2642] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:17:41.881062 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:41.946872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8d18-5cc4-4c94-bf43-8fe5cd6ceaa4 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:41.952331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:41.953128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:41.953419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:41.953694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] PATH_INFO: `/v3/users/8029352449b6440f93d879e40126042f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:41.955067 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8029352449b6440f93d879e40126042f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:41.957005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:41.958765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:42.132880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8029352449b6440f93d879e40126042f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:42.133547 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8029352449b6440f93d879e40126042f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:42.143054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8029352449b6440f93d879e40126042f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:42.178042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8029352449b6440f93d879e40126042f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:42.266133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8029352449b6440f93d879e40126042f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:42.274446 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1338/2643] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:41 2022] DELETE /identity/v3/users/8029352449b6440f93d879e40126042f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:42.279422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:42.279926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:42.280010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:42.308685 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:17:42.311568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:42.387403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1306/2644] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:17:42.398103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:42.399904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:42.489496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af52bd-6348-49e0-88c2-f547dda993c7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:42.493567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:42.494022 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:42.494304 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:42.494587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:42.515664 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:42.517522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:42.528761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1339/2645] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:17:42.913515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:42.915015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:42.928718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb2548-2594-4cf4-b159-4b63e619f919 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:42.933746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:42.934420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:42.934732 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:42.935037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] PATH_INFO: `/v3/users/2e56b9ff50c7434fbd7745a950628f77` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:42.936161 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e56b9ff50c7434fbd7745a950628f77)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:42.938341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:43.004332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:43.006323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:43.025691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a202941-e9f1-454d-befa-b2964ec0b25f service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:43.033061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:43.034163 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:43.034650 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:43.035145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] PATH_INFO: `/v3/projects/0aa892d53f8f4798a6fc0ad63e91cce8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:43.037132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa892d53f8f4798a6fc0ad63e91cce8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:43.040920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:43.107266 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e56b9ff50c7434fbd7745a950628f77'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.107916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e56b9ff50c7434fbd7745a950628f77'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.112374 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:43.120892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e56b9ff50c7434fbd7745a950628f77'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.133556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa892d53f8f4798a6fc0ad63e91cce8', 'request_id': 'req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.140350 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa892d53f8f4798a6fc0ad63e91cce8', 'request_id': 'req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.224294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e56b9ff50c7434fbd7745a950628f77'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.224922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e56b9ff50c7434fbd7745a950628f77'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.238299 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1307/2646] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:42 2022] DELETE /identity/v3/users/2e56b9ff50c7434fbd7745a950628f77 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:43.289200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa892d53f8f4798a6fc0ad63e91cce8', 'request_id': 'req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.300864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] The token cache is being invalidate because project 0aa892d53f8f4798a6fc0ad63e91cce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:43.301160 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.301811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.303380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1340/2647] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:43 2022] DELETE /identity/v3/projects/0aa892d53f8f4798a6fc0ad63e91cce8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:17:43.548818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:43.550451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:43.622998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03845f9-17a4-418e-a5ef-9fcd130265b4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:43.627558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:43.628190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:43.628467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:43.628739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] PATH_INFO: `/v3/projects/7113166016704f999cce7f533a8299ac` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:43.629919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7113166016704f999cce7f533a8299ac)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:43.638082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:43.744096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7113166016704f999cce7f533a8299ac', 'request_id': 'req-78690d62-5422-49cc-8449-c2801d02f3ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.750289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7113166016704f999cce7f533a8299ac', 'request_id': 'req-78690d62-5422-49cc-8449-c2801d02f3ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.830357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7113166016704f999cce7f533a8299ac', 'request_id': 'req-78690d62-5422-49cc-8449-c2801d02f3ba'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.841995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] The token cache is being invalidate because project 7113166016704f999cce7f533a8299ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:43.842281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.842903 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:43.844387 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1308/2648] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:43 2022] DELETE /identity/v3/projects/7113166016704f999cce7f533a8299ac => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:43.848434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:43.849801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:43.855947 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:43.912773 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c1cea-a4c3-4eb0-bd6b-a7de88a258c3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:43.969370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:43.970058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:43.970341 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:43.972125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] PATH_INFO: `/v3/users/3fb9e943c8184ae59d654ea55cfb59ad` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:43.973693 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb9e943c8184ae59d654ea55cfb59ad)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:43.976159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:44.163788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb9e943c8184ae59d654ea55cfb59ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.164431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb9e943c8184ae59d654ea55cfb59ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.171616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb9e943c8184ae59d654ea55cfb59ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.184019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb9e943c8184ae59d654ea55cfb59ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.282969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb9e943c8184ae59d654ea55cfb59ad'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.289488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1341/2649] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:17:43 2022] DELETE /identity/v3/users/3fb9e943c8184ae59d654ea55cfb59ad => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:44.530631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:17:44.532057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:17:44.547429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78690d62-5422-49cc-8449-c2801d02f3ba admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:17:44.609032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:17:44.609885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:17:44.610008 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:17:44.610256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] PATH_INFO: `/v3/projects/e115705bd18d483ab27f43814e27a076` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:17:44.611398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e115705bd18d483ab27f43814e27a076)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:17:44.613366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:17:44.614915 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:44.734080 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e115705bd18d483ab27f43814e27a076', 'request_id': 'req-8a95752a-3964-4c88-a33b-e5df859505a4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.740199 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e115705bd18d483ab27f43814e27a076', 'request_id': 'req-8a95752a-3964-4c88-a33b-e5df859505a4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.813001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e115705bd18d483ab27f43814e27a076', 'request_id': 'req-8a95752a-3964-4c88-a33b-e5df859505a4'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.824049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] The token cache is being invalidate because project e115705bd18d483ab27f43814e27a076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:17:44.832062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.832062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:17:44.832062 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1309/2650] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:17:44 2022] DELETE /identity/v3/projects/e115705bd18d483ab27f43814e27a076 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:17:54.285898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:17:54.820734 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:40.444023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:40.445483 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:40.513498 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73847-7b2c-41c1-815f-765a320018c6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:40.569315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:40.569963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:40.570259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:40.570527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:40.572564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:40.637930 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:40.639357 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:40.649144 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1342/2651] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:18:44.317933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:44.319450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:44.332853 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95752a-3964-4c88-a33b-e5df859505a4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:44.337354 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:44.338010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:44.338294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:44.338568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:44.341034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:44.572155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:44.573628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:44.616519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1310/2652] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:18:45.281826 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:45.283301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:45.302795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4de7d-ac88-418b-abf0-a546388dc3e7 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:45.302795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:45.302795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:45.302795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:45.303221 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] PATH_INFO: `/v3/users/9c9e8d7ae50941ba9e76138aaf604d41` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:45.303985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9e8d7ae50941ba9e76138aaf604d41)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:45.305942 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:45.519198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9e8d7ae50941ba9e76138aaf604d41'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:45.519847 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9e8d7ae50941ba9e76138aaf604d41'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:45.526872 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9e8d7ae50941ba9e76138aaf604d41'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:45.531889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:45.539963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9e8d7ae50941ba9e76138aaf604d41'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:45.611734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-85fc7e16-3e40-42d9-9915-563430b6c093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9e8d7ae50941ba9e76138aaf604d41'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:45.618612 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1343/2653] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:18:45 2022] DELETE /identity/v3/users/9c9e8d7ae50941ba9e76138aaf604d41 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:18:45.920746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:45.932346 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8d3a3-9edd-4d75-8d7f-48b590f02050 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:46.011979 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:46.012635 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.013584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.013919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] PATH_INFO: `/v3/projects/9077920093cb4ff3a6b7a3aea2e7cd29` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.015165 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9077920093cb4ff3a6b7a3aea2e7cd29)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:46.017118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:46.167650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9077920093cb4ff3a6b7a3aea2e7cd29', 'request_id': 'req-2876a73f-27be-4a1c-8165-927041ef519f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:46.174855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9077920093cb4ff3a6b7a3aea2e7cd29', 'request_id': 'req-2876a73f-27be-4a1c-8165-927041ef519f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:46.253431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9077920093cb4ff3a6b7a3aea2e7cd29', 'request_id': 'req-2876a73f-27be-4a1c-8165-927041ef519f'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:46.259177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:46.267516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] The token cache is being invalidate because project 9077920093cb4ff3a6b7a3aea2e7cd29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:18:46.267892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:46.268497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2876a73f-27be-4a1c-8165-927041ef519f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:46.270050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1311/2654] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:18:45 2022] DELETE /identity/v3/projects/9077920093cb4ff3a6b7a3aea2e7cd29 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:18:46.276261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.276794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.277289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.313428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:46.315791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:46.410536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1344/2655] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:18:46.419472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.419696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.419950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.444977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:46.453288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:46.465726 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1312/2656] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:46.470625 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:46.480751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a520f-7929-4ff9-a6f2-ef47ac428103 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:46.488337 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:46.489557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.490140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.490639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.492147 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:18:46.492758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:46.496021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:46.521704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1345/2657] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:18:46.523110 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:46.535278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7e945-97dd-42aa-8fb4-4368ddafb896 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:46.540961 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:46.541832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.542167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.542445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.543094 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:46.545082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:46.678928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1313/2658] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:18:46.685356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:46.704711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cbe04-80b6-415c-b8af-c32e6448f0ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:46.778898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:46.779527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.779808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.780084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.780829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:46.782870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:46.916584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1346/2659] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:18:46 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:18:46.922742 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:46.933611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7c58d-b08f-4b31-8309-55bbf9cadda6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:46.939380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:46.940009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.940297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.940572 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.941274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:46.942995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:46.954983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1314/2660] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:18:46.959278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:46.970099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445246-8d93-4585-90cf-ff7011ea100d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:46.974751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6788-2dd2-4019-a80b-3c433c1bdb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:46.975358 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6788-2dd2-4019-a80b-3c433c1bdb6b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:46.975640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6788-2dd2-4019-a80b-3c433c1bdb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:46.975911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6788-2dd2-4019-a80b-3c433c1bdb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:46.976549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f6788-2dd2-4019-a80b-3c433c1bdb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:46.978257 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f6788-2dd2-4019-a80b-3c433c1bdb6b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:46.990094 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1347/2661] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:18:46.994417 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:47.005317 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c1c4f-77d7-47b0-9b65-113ed5bdc197 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:47.009996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:47.010657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:47.010940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:47.011216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] PATH_INFO: `/v3/projects/26b0aee74ef440a3935ee030c4cb9a4c/users/bcb483963ba446d6ae45064ca5c357b1/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:47.027671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b0aee74ef440a3935ee030c4cb9a4c, user_id=bcb483963ba446d6ae45064ca5c357b1, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:47.030444 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:47.150933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1315/2662] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:18:46 2022] PUT /identity/v3/projects/26b0aee74ef440a3935ee030c4cb9a4c/users/bcb483963ba446d6ae45064ca5c357b1/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:18:47.156242 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:47.156527 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:47.156805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:47.177966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:47.179083 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:47.221597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:47.241957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1348/2663] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:18:47.252805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:47.254558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:47.315457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f411363-b951-48f6-8136-4ab6b33cd323 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:47.319221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21848d0c-e608-4a22-ac4e-a06b377cba4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:47.319837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848d0c-e608-4a22-ac4e-a06b377cba4c service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:47.320121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848d0c-e608-4a22-ac4e-a06b377cba4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:47.320401 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21848d0c-e608-4a22-ac4e-a06b377cba4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:47.330884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848d0c-e608-4a22-ac4e-a06b377cba4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:47.332383 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21848d0c-e608-4a22-ac4e-a06b377cba4c service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:47.343700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1316/2664] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:18:49.634469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:49.636375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:49.652255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb2088-a066-4101-bb6d-4c8e5343f39c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:49.662306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:49.662948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:49.663378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:49.663657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:49.665451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:49.696059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:49.698954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:49.709832 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1349/2665] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:18:53.385135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:53.386198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:53.386484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:53.424156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] MFA Rules not processed for user `bcb483963ba446d6ae45064ca5c357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:53.425472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:53.544837 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1317/2666] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:53.581869 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:53.585419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:53.719103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949345-f39a-4a2f-8415-f6cb8205b095 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:53.725225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:53.726652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:53.726785 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:53.727029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:53.745423 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:53.748495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:53.771099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1350/2667] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:18:54.449716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:54.452560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:54.474851 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4341ae-e9e7-483c-9fcd-e5ad0bc4ce08 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:54.480414 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:54.490731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:54.490731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:54.490731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] PATH_INFO: `/v3/users/df1f64397b6e4dbeb1f39d1a27b3da3d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:54.506887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:54.510408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1f64397b6e4dbeb1f39d1a27b3da3d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:54.512660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:54.766634 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1f64397b6e4dbeb1f39d1a27b3da3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:54.767225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1f64397b6e4dbeb1f39d1a27b3da3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:54.787679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1f64397b6e4dbeb1f39d1a27b3da3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:54.927628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1f64397b6e4dbeb1f39d1a27b3da3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:54.928362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-48bdf405-da9d-44ef-9c57-7624dbe0d99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1f64397b6e4dbeb1f39d1a27b3da3d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:54.943819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1318/2668] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:18:54 2022] DELETE /identity/v3/users/df1f64397b6e4dbeb1f39d1a27b3da3d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:18:55.225391 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:55.247226 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c5baa-5c9e-47ec-97f1-dd57ea93d14c service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:55.323199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:55.323755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:55.324237 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:55.324700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] PATH_INFO: `/v3/projects/6e2eefe1169a4f9eafa9708b3ec62314` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:55.338336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2eefe1169a4f9eafa9708b3ec62314)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:55.340581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:55.455224 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2eefe1169a4f9eafa9708b3ec62314', 'request_id': 'req-fdf9cad8-bf4e-4983-adcc-f87c76065a49'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:55.456874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:55.474996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2eefe1169a4f9eafa9708b3ec62314', 'request_id': 'req-fdf9cad8-bf4e-4983-adcc-f87c76065a49'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:55.543493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2eefe1169a4f9eafa9708b3ec62314', 'request_id': 'req-fdf9cad8-bf4e-4983-adcc-f87c76065a49'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:55.556663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] The token cache is being invalidate because project 6e2eefe1169a4f9eafa9708b3ec62314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:18:55.556954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:55.557656 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fdf9cad8-bf4e-4983-adcc-f87c76065a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:18:55.559660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1351/2669] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:18:55 2022] DELETE /identity/v3/projects/6e2eefe1169a4f9eafa9708b3ec62314 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:18:55.564706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:55.565210 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:55.575694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:55.597489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:55.598918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:55.691506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1319/2670] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:55.700179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:55.701248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:55.701714 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:55.725312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:55.726666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:55.736036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1352/2671] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:55.742057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:55.761403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3fb86-108e-4db8-a89d-f3d488c0ee67 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:55.768599 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:55.769283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:55.769598 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:55.770314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:55.776820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:18:55.776820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:55.776820 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:55.789236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1320/2672] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:18:55.794154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:55.804969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25115a19-6d82-4687-a04a-6fd6f7274466 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:55.811399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:55.812672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:55.812672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:55.812915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:55.813637 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:55.816090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:55.942985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1353/2673] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:18:55 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:18:55.948319 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:55.976748 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f175097-5ffb-4cd7-b975-beb6f3320f1f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:56.084194 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:56.084857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.085145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.085424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.086249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:56.096056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:56.104869 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:56.213660 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1321/2674] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:18:55 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:18:56.215899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:56.249746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3308071-e307-4b9c-a0ca-218815ac9b0b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:56.268154 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:56.269084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.269535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.270029 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.270700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:56.272364 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:56.288033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1354/2675] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:18:56.290032 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:56.312126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e08d-7d63-4c1d-b60a-b5fe01ae61aa admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:56.321693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7612fc1-cdca-4991-bfd6-67ebd17a3c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:56.322888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612fc1-cdca-4991-bfd6-67ebd17a3c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.323497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612fc1-cdca-4991-bfd6-67ebd17a3c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.323948 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7612fc1-cdca-4991-bfd6-67ebd17a3c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.325298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612fc1-cdca-4991-bfd6-67ebd17a3c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:56.327461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7612fc1-cdca-4991-bfd6-67ebd17a3c1e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:56.345033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1322/2676] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:18:56.347209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:56.363013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426b0f2-7934-4005-b84d-0b653d9ffc95 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:56.368752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d96f-1932-42ea-ad35-41abf9c1cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:56.370324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d96f-1932-42ea-ad35-41abf9c1cdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.370324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d96f-1932-42ea-ad35-41abf9c1cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.371046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d96f-1932-42ea-ad35-41abf9c1cdb4 admin admin] PATH_INFO: `/v3/projects/8f36437624f4439d9a4f8a2a91ef9132/users/fe7276c732774da3a6a0c00df9b70521/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.389108 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d96f-1932-42ea-ad35-41abf9c1cdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f36437624f4439d9a4f8a2a91ef9132, user_id=fe7276c732774da3a6a0c00df9b70521, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:56.392377 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d96f-1932-42ea-ad35-41abf9c1cdb4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:56.506086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.506547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.506945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.509803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1355/2677] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:18:56 2022] PUT /identity/v3/projects/8f36437624f4439d9a4f8a2a91ef9132/users/fe7276c732774da3a6a0c00df9b70521/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:18:56.540538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] MFA Rules not processed for user `fe7276c732774da3a6a0c00df9b70521`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:56.542020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:56.646713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1323/2678] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:56.649195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.649481 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.649754 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.653950 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:56.683956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] MFA Rules not processed for user `bcb483963ba446d6ae45064ca5c357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:56.693404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:56.738489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3344176-0317-46ba-8122-97798cc0d8c2 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:56.750758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:56.750758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:56.750758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:56.750758 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:56.751213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:56.751213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:56.770276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1356/2679] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:56.942679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1324/2680] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:18:56 2022] POST /identity/v3/projects => generated 367 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:18:56.946605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:56.965399 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27e949-920b-4b80-ac6f-eab057ab0cd6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.055073 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.055722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.056011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.056288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.056958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.059095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.186011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1357/2681] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:18:56 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:18:57.190419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.202312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26cc9e-40a3-48e0-82ad-f8239620c0d1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.208244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.209042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.209304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.209582 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.210288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.211980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.225718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1325/2682] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:18:57.229827 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.242565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908de0a-2dfb-408c-9e0d-9af66fc72462 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.247639 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.248472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.248762 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.249038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] PATH_INFO: `/v3/projects/d81241db571542279af1b1e1fc8d2749/users/e914d6e166ea4011addf942ae2dddb97/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.254084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:57.268845 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81241db571542279af1b1e1fc8d2749, user_id=e914d6e166ea4011addf942ae2dddb97, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.271477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.358982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1358/2683] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:18:57 2022] PUT /identity/v3/projects/d81241db571542279af1b1e1fc8d2749/users/e914d6e166ea4011addf942ae2dddb97/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:18:57.364005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.375650 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302b19-acdc-4a11-b3b6-904aef64d991 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.436104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:18:57.455170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96718c-f7fb-410c-adea-dcd3222afc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.456410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96718c-f7fb-410c-adea-dcd3222afc22 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.456410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96718c-f7fb-410c-adea-dcd3222afc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.458173 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96718c-f7fb-410c-adea-dcd3222afc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.458951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96718c-f7fb-410c-adea-dcd3222afc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.460762 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96718c-f7fb-410c-adea-dcd3222afc22 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.473523 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1326/2684] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:18:57.485992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.497651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc4109-ff98-4d27-b753-c4f31dd51086 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.502877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.503694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.503971 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.504243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] PATH_INFO: `/v3/projects/d81241db571542279af1b1e1fc8d2749/users/e914d6e166ea4011addf942ae2dddb97/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.506977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81241db571542279af1b1e1fc8d2749, user_id=e914d6e166ea4011addf942ae2dddb97, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.510014 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.530927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1359/2685] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:18:57 2022] PUT /identity/v3/projects/d81241db571542279af1b1e1fc8d2749/users/e914d6e166ea4011addf942ae2dddb97/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:18:57.541622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.542011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.542293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.572814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] MFA Rules not processed for user `e914d6e166ea4011addf942ae2dddb97`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:18:57.574214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:57.666111 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.672013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:57.705585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1327/2686] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:18:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:18:57.720508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.722681 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:57.757047 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716a8b9-db9b-4348-b62e-05797eaae443 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.760552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.761168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.761450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.761722 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.763622 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:57.812331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab603e-4202-49bf-8e99-92eb82cb1162 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:57.818020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:57.818533 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:57.818928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:57.819124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:57.837424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.840352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.856302 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1328/2687] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:18:57.871700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:57.873395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:57.890249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1360/2688] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:18:57.994779 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:18:57.996223 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:18:58.008519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9a5d9-b08a-4b80-9088-6ee9ee887144 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:18:58.015951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161f397-a51c-402e-981b-381fae98e66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:18:58.016606 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f397-a51c-402e-981b-381fae98e66b service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:18:58.016885 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f397-a51c-402e-981b-381fae98e66b service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:18:58.017298 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161f397-a51c-402e-981b-381fae98e66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:18:58.108013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161f397-a51c-402e-981b-381fae98e66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:18:58.110878 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161f397-a51c-402e-981b-381fae98e66b service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:18:58.122339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1329/2689] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:03.603716 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:03.679911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5d341-63f1-472a-856b-53cf115e69f7 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:03.684736 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:03.685370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:03.686255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:03.686542 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] PATH_INFO: `/v3/users/fe7276c732774da3a6a0c00df9b70521` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:03.687733 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7276c732774da3a6a0c00df9b70521)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:03.689674 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:03.705624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:04.060089 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7276c732774da3a6a0c00df9b70521'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:04.061781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7276c732774da3a6a0c00df9b70521'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:04.073818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7276c732774da3a6a0c00df9b70521'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:04.090591 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7276c732774da3a6a0c00df9b70521'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:04.202204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7276c732774da3a6a0c00df9b70521'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:04.209734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1361/2690] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:19:03 2022] DELETE /identity/v3/users/fe7276c732774da3a6a0c00df9b70521 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:19:04.215010 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:04.215520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:04.215616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:04.237816 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:04.239775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:04.245994 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:04.308494 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1330/2691] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:04.319987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:04.321646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:04.389920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc76bc-df2e-4449-8746-7c2991849c21 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:04.393987 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:04.394614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:04.394898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:04.395166 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:04.405565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:04.407451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:04.418606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1362/2692] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:05.181236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:05.190134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:05.197793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61393c8-9427-4414-ba46-b10ac56336ac None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:05.204114 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:05.204889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:05.205242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:05.205583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] PATH_INFO: `/v3/projects/8f36437624f4439d9a4f8a2a91ef9132` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:05.206933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f36437624f4439d9a4f8a2a91ef9132)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:05.209093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:05.364464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f36437624f4439d9a4f8a2a91ef9132', 'request_id': 'req-90f9d5cc-7edb-459f-a16d-47972fc3c960'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.371056 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f36437624f4439d9a4f8a2a91ef9132', 'request_id': 'req-90f9d5cc-7edb-459f-a16d-47972fc3c960'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.474577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f36437624f4439d9a4f8a2a91ef9132', 'request_id': 'req-90f9d5cc-7edb-459f-a16d-47972fc3c960'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.486892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] The token cache is being invalidate because project 8f36437624f4439d9a4f8a2a91ef9132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:19:05.487178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.489091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.490861 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1331/2693] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:19:05 2022] DELETE /identity/v3/projects/8f36437624f4439d9a4f8a2a91ef9132 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:05.493578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:05.503353 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc371-dafd-470b-828d-5cd8b720d5ac service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:05.560788 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:05.561577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:05.561982 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:05.562320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] PATH_INFO: `/v3/users/e914d6e166ea4011addf942ae2dddb97` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:05.563932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e914d6e166ea4011addf942ae2dddb97)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:05.566776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:05.843830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:05.852997 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e914d6e166ea4011addf942ae2dddb97'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.853683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e914d6e166ea4011addf942ae2dddb97'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.862396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e914d6e166ea4011addf942ae2dddb97'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.877013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e914d6e166ea4011addf942ae2dddb97'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.956081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1e3b225a-4dfe-4b83-aeeb-86a1d4619578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e914d6e166ea4011addf942ae2dddb97'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:05.962795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1363/2694] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:19:05 2022] DELETE /identity/v3/users/e914d6e166ea4011addf942ae2dddb97 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:19:06.514712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:06.516340 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:06.548946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d5cc-7edb-459f-a16d-47972fc3c960 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:06.639320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:06.640036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:06.640407 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:06.640695 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] PATH_INFO: `/v3/projects/d81241db571542279af1b1e1fc8d2749` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:06.641898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81241db571542279af1b1e1fc8d2749)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:06.643919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:06.784886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:06.795934 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81241db571542279af1b1e1fc8d2749', 'request_id': 'req-cb2938e6-1ba3-4370-b621-8289a51c54fd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:06.804350 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81241db571542279af1b1e1fc8d2749', 'request_id': 'req-cb2938e6-1ba3-4370-b621-8289a51c54fd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:06.892255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81241db571542279af1b1e1fc8d2749', 'request_id': 'req-cb2938e6-1ba3-4370-b621-8289a51c54fd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:06.906875 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] The token cache is being invalidate because project d81241db571542279af1b1e1fc8d2749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:19:06.907313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:06.908180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cb2938e6-1ba3-4370-b621-8289a51c54fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:06.910079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1332/2695] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:19:06 2022] DELETE /identity/v3/projects/d81241db571542279af1b1e1fc8d2749 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:06.917597 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:06.918201 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:06.918395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:06.940292 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:06.941697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:07.010897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1364/2696] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:07.019916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.020653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.021366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.044137 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:07.045959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:07.054845 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1333/2697] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:07.059573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.075891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c536707-5112-43da-af0f-c770e5ef633b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.084721 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.085824 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.086561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.086919 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.088155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:19:07.088706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.092681 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.116672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1365/2698] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:19:07.121721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.132015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376262b-a949-4a4f-8003-ce4c91a43b6b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.137696 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.138546 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.138892 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.139227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.140013 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.142128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.250490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1334/2699] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:07.254673 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.267080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6660c-5731-4228-898b-12cac754ac39 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.328616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.329240 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.329524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.329801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.330493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.332455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.411142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1366/2700] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:19:07 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:07.415712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.434896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e875c49-30ca-423a-b80a-ea919cee0eec admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.443842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.444972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.445477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.446026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.447212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.452450 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.473609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1335/2701] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:19:07.479244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.491645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53889b3-92c3-4dfd-8817-c4693c6e8bf0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.497340 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd2cf3-ebeb-4311-b7f6-25d888480a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.498150 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2cf3-ebeb-4311-b7f6-25d888480a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.498535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2cf3-ebeb-4311-b7f6-25d888480a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.498938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2cf3-ebeb-4311-b7f6-25d888480a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.499867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd2cf3-ebeb-4311-b7f6-25d888480a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.501780 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd2cf3-ebeb-4311-b7f6-25d888480a00 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.516470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1367/2702] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:07.521001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.533160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bdf81-cf2c-450f-9bd4-784fd8349f9f admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.539909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.541276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.541784 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.542347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] PATH_INFO: `/v3/projects/b7651c33f5e24a5cbaeef7ec574c8102/users/f12f2f41cf2746dcb7b9d1ea747b082a/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.571507 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7651c33f5e24a5cbaeef7ec574c8102, user_id=f12f2f41cf2746dcb7b9d1ea747b082a, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.577230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.693755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1336/2703] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:19:07 2022] PUT /identity/v3/projects/b7651c33f5e24a5cbaeef7ec574c8102/users/f12f2f41cf2746dcb7b9d1ea747b082a/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:19:07.708301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.708301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.708301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.742819 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] MFA Rules not processed for user `f12f2f41cf2746dcb7b9d1ea747b082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:07.744545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:07.754923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:07.822404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1368/2704] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:19:07.827699 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:07.904712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc64f9-3f4c-49f3-baa9-72cf55eca93b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:07.909836 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:07.910488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:07.910767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:07.911041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:07.911700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:07.913633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:07.992651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1337/2705] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:07.997024 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:08.017118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fc4eb-689f-4e95-adce-7a3fdf5bcab0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:08.118331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:08.118830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.119117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.119393 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.120074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:08.122079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:08.214428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1369/2706] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:19:07 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:19:08.218876 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:08.231730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08a600-4f2c-41e9-b72b-11e2ab8105eb admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:08.238504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:08.239426 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.239886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.240336 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.241141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:08.243036 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:08.258392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1338/2707] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:08.262730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:08.273993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e7833-31d9-475a-bdbd-b43780e1aaf2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:08.279347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:08.280191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.280482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.280921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] PATH_INFO: `/v3/projects/256d8a75ad574513b2b8dfb291077788/users/dc03ea5f760e4e5194b6b0f274afff5d/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.304247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=256d8a75ad574513b2b8dfb291077788, user_id=dc03ea5f760e4e5194b6b0f274afff5d, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:08.307315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:08.431662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1370/2708] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:19:08 2022] PUT /identity/v3/projects/256d8a75ad574513b2b8dfb291077788/users/dc03ea5f760e4e5194b6b0f274afff5d/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:19:08.435893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:08.449198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710b28-bc2d-49ba-81fc-18919c102aa8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:08.487575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:08.516556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6e7f9-4924-40fb-9724-a4634b603793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:08.517092 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6e7f9-4924-40fb-9724-a4634b603793 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.517361 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6e7f9-4924-40fb-9724-a4634b603793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.517689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6e7f9-4924-40fb-9724-a4634b603793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.518370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6e7f9-4924-40fb-9724-a4634b603793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:08.520029 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6e7f9-4924-40fb-9724-a4634b603793 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:08.532023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1339/2709] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:08.536856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:08.548765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd93ac-ac34-44d4-a40a-0a35cb328b2e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:08.553593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:08.554324 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.554583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.554863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] PATH_INFO: `/v3/projects/256d8a75ad574513b2b8dfb291077788/users/dc03ea5f760e4e5194b6b0f274afff5d/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.556886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256d8a75ad574513b2b8dfb291077788, user_id=dc03ea5f760e4e5194b6b0f274afff5d, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:08.559593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:08.571458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1371/2710] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:19:08 2022] PUT /identity/v3/projects/256d8a75ad574513b2b8dfb291077788/users/dc03ea5f760e4e5194b6b0f274afff5d/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:19:08.583071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.583531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.584242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.617428 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] MFA Rules not processed for user `dc03ea5f760e4e5194b6b0f274afff5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:08.618831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:08.707746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1340/2711] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:19:08.723196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:08.725998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:08.810218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace651c0-3292-427b-9d23-a13877bbff40 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:08.814321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:08.814944 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:08.815274 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:08.815552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:08.826981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:08.828457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:08.840430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1372/2712] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:09.002966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:09.016304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eafcd-e6d5-49f5-870b-c32296753274 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:09.021884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:09.022835 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:09.023338 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:09.023766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:09.116244 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:09.117883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:09.129593 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1341/2713] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:10.214176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:10.216747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:10.230923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:10.301090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa44cd2-3981-4cc9-8bab-d4e5520d17bb service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:10.303363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:10.304135 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:10.304564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:10.304949 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:10.307349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:10.319501 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:10.321301 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0bd2d6-ce0f-4d12-b730-8f852fa95ed3 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:10.332448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1373/2714] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:13.809627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:13.874488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=100 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:13.886059 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4faf4-66a4-4851-9864-cbff6683c949 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:13.891170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:13.891807 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:13.892087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:13.892362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] PATH_INFO: `/v3/users/f12f2f41cf2746dcb7b9d1ea747b082a` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:13.893577 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12f2f41cf2746dcb7b9d1ea747b082a)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:13.895637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:14.107918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12f2f41cf2746dcb7b9d1ea747b082a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:14.108761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12f2f41cf2746dcb7b9d1ea747b082a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:14.128454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12f2f41cf2746dcb7b9d1ea747b082a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:14.203039 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12f2f41cf2746dcb7b9d1ea747b082a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:14.204034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12f2f41cf2746dcb7b9d1ea747b082a'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:14.226280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1342/2715] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:19:13 2022] DELETE /identity/v3/users/f12f2f41cf2746dcb7b9d1ea747b082a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:14.233435 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:14.234158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:14.234638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:14.260258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:14.261528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:14.369957 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1374/2716] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:14.381074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:14.384647 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:14.488583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879147-bef8-4773-a287-4214c1f9d241 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:14.495023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:14.496051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:14.496542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:14.497334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:14.514617 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:14.517237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:14.539330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1343/2717] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:15.301351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:15.308182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:15.336580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700fa75-89b7-46dd-9baa-7e758dfee656 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:15.342953 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:15.343938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:15.344200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:15.344661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] PATH_INFO: `/v3/projects/b7651c33f5e24a5cbaeef7ec574c8102` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:15.345960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7651c33f5e24a5cbaeef7ec574c8102)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:15.347920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:15.499309 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7651c33f5e24a5cbaeef7ec574c8102', 'request_id': 'req-683112f1-8e58-4d86-9bf7-9a084230571e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.512013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7651c33f5e24a5cbaeef7ec574c8102', 'request_id': 'req-683112f1-8e58-4d86-9bf7-9a084230571e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.624382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7651c33f5e24a5cbaeef7ec574c8102', 'request_id': 'req-683112f1-8e58-4d86-9bf7-9a084230571e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.639731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] The token cache is being invalidate because project b7651c33f5e24a5cbaeef7ec574c8102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:19:15.640175 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.640963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.642885 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1375/2718] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:19:15 2022] DELETE /identity/v3/projects/b7651c33f5e24a5cbaeef7ec574c8102 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:19:15.647125 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:15.658884 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282598f6-32f0-4aee-bf9d-aab1fef3a8e2 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:15.735713 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:15.736355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:15.736630 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:15.736907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] PATH_INFO: `/v3/users/dc03ea5f760e4e5194b6b0f274afff5d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:15.738153 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc03ea5f760e4e5194b6b0f274afff5d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:15.740148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:15.761017 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:15.946240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc03ea5f760e4e5194b6b0f274afff5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.946949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc03ea5f760e4e5194b6b0f274afff5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:15.967183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc03ea5f760e4e5194b6b0f274afff5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.040051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc03ea5f760e4e5194b6b0f274afff5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.040683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-2b9663d6-e0f5-45ab-a44b-02b34aaeb016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc03ea5f760e4e5194b6b0f274afff5d'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.055169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1344/2719] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:19:15 2022] DELETE /identity/v3/users/dc03ea5f760e4e5194b6b0f274afff5d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:16.513682 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:16.523348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:16.529476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683112f1-8e58-4d86-9bf7-9a084230571e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:16.574232 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:16.610525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:16.611300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:16.611502 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:16.611774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] PATH_INFO: `/v3/projects/256d8a75ad574513b2b8dfb291077788` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:16.612933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256d8a75ad574513b2b8dfb291077788)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:16.614896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:16.747065 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256d8a75ad574513b2b8dfb291077788', 'request_id': 'req-63388892-e5bc-436d-b24a-ed9091891060'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.753807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256d8a75ad574513b2b8dfb291077788', 'request_id': 'req-63388892-e5bc-436d-b24a-ed9091891060'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.887425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256d8a75ad574513b2b8dfb291077788', 'request_id': 'req-63388892-e5bc-436d-b24a-ed9091891060'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.899893 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] The token cache is being invalidate because project 256d8a75ad574513b2b8dfb291077788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:19:16.900188 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.900859 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63388892-e5bc-436d-b24a-ed9091891060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:16.904429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1376/2720] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:19:16 2022] DELETE /identity/v3/projects/256d8a75ad574513b2b8dfb291077788 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:16.908408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:16.908956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:16.909055 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:16.929936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:16.931248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:16.993233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1345/2721] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:17.001372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.001661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.001975 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.023818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:17.025046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:17.034036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1377/2722] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:17.038472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.049155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137a02-443c-402c-a49a-5826d6ce47fd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.053833 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.054478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.054760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.055035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.055688 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:19:17.055996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.057616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.071977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1346/2723] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:19:17.076448 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.085779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fd569-271d-4aab-9e17-7faac79ada23 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.090779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.091877 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.092152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.092422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.093051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.094989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.184665 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1378/2724] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:19:17 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:17.188974 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.199422 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ada3dc-91b1-49d5-930b-2765e7b441e5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.262680 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.263297 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.263604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.263898 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.264584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.266677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.354939 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1347/2725] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:19:17 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:17.359432 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.370208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398112b4-9fb2-46bf-ac44-f91a6d799145 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.374850 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.375469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.375747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.376017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.376660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.378290 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.389265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1379/2726] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:17.394446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.405411 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0afdaa-4cb9-4ffa-bfcd-ca2edc539270 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.410278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e29b6-4ae8-4575-9681-a1a0805f1499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.410906 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e29b6-4ae8-4575-9681-a1a0805f1499 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.411190 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e29b6-4ae8-4575-9681-a1a0805f1499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.411466 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e29b6-4ae8-4575-9681-a1a0805f1499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.412148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e29b6-4ae8-4575-9681-a1a0805f1499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.413818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e29b6-4ae8-4575-9681-a1a0805f1499 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.419887 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:17.426003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1348/2727] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:17.430387 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.440701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c9a7-dd5d-4605-889c-66c4033e9f13 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.445250 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.445923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.446203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.446473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] PATH_INFO: `/v3/projects/03fb262cc8f84165b5850fabd4367d76/users/b4fef098a79844c3bc03fa3ffaed9023/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.465185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fb262cc8f84165b5850fabd4367d76, user_id=b4fef098a79844c3bc03fa3ffaed9023, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.468584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.545063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1380/2728] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:19:17 2022] PUT /identity/v3/projects/03fb262cc8f84165b5850fabd4367d76/users/b4fef098a79844c3bc03fa3ffaed9023/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:17.556824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.557174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.557555 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.590148 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] MFA Rules not processed for user `b4fef098a79844c3bc03fa3ffaed9023`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:17.591954 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:17.656730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1349/2729] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:17.668286 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:17.670220 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:17.727698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a91da-c7a2-45db-810d-18269bfe38c1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:17.731314 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14b96e-eb0b-4ba8-94d7-c2ab3e1bb623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:17.732005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14b96e-eb0b-4ba8-94d7-c2ab3e1bb623 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:17.732282 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14b96e-eb0b-4ba8-94d7-c2ab3e1bb623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:17.732593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14b96e-eb0b-4ba8-94d7-c2ab3e1bb623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:17.740960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14b96e-eb0b-4ba8-94d7-c2ab3e1bb623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:17.742537 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14b96e-eb0b-4ba8-94d7-c2ab3e1bb623 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:17.746995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:17.751990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1381/2730] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:27.653882 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=32 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:36.679128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:36.751122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6fd7-fa16-4a2a-a2ce-20a50ab75a6c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:36.755777 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:36.756420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:36.756700 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:36.757091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] PATH_INFO: `/v3/users/b4fef098a79844c3bc03fa3ffaed9023` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:36.758155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fef098a79844c3bc03fa3ffaed9023)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:36.763929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:37.006942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fef098a79844c3bc03fa3ffaed9023'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:37.007633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fef098a79844c3bc03fa3ffaed9023'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:37.022854 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fef098a79844c3bc03fa3ffaed9023'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:37.093303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fef098a79844c3bc03fa3ffaed9023'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:37.094051 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fef098a79844c3bc03fa3ffaed9023'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:37.109811 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1350/2731] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:19:36 2022] DELETE /identity/v3/users/b4fef098a79844c3bc03fa3ffaed9023 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:37.114933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:37.115578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:37.115578 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:37.136603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:37.138704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:37.211190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1382/2732] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:37.222066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:37.223626 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:37.287618 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd892754-9241-477d-867f-c37ed113bfa8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:37.291146 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414ddc4-d78d-451d-b5a2-d7f7dec367cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:37.291760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ddc4-d78d-451d-b5a2-d7f7dec367cf service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:37.292041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ddc4-d78d-451d-b5a2-d7f7dec367cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:37.292327 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ddc4-d78d-451d-b5a2-d7f7dec367cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:37.302475 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414ddc4-d78d-451d-b5a2-d7f7dec367cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:37.304170 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414ddc4-d78d-451d-b5a2-d7f7dec367cf service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:37.316502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1351/2733] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:19:37.949076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:37.954246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:37.976573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d425-ef07-44ca-9d79-71b8ce2709db None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:37.983961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:37.991711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:37.991711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:37.991711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] PATH_INFO: `/v3/projects/03fb262cc8f84165b5850fabd4367d76` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:37.991711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fb262cc8f84165b5850fabd4367d76)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:37.995076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.168128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fb262cc8f84165b5850fabd4367d76', 'request_id': 'req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:38.177382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fb262cc8f84165b5850fabd4367d76', 'request_id': 'req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:38.262289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fb262cc8f84165b5850fabd4367d76', 'request_id': 'req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:38.274912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] The token cache is being invalidate because project 03fb262cc8f84165b5850fabd4367d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:19:38.275362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:38.275897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1a44bb41-cabf-4b78-a5d2-1a39d887ccbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:38.277439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1383/2734] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:19:37 2022] DELETE /identity/v3/projects/03fb262cc8f84165b5850fabd4367d76 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:38.286966 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.287659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.287768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.311180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:38.312326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:38.331653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:38.381157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1352/2735] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:19:38.390285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.390630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.390996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.413619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:38.414888 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:38.423211 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1384/2736] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:19:38.428212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:38.440252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dc5b2-52aa-4d1e-98ef-26ab267a548d None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:38.445579 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:38.446239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.446515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.447776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.447776 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:19:38.448131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:38.449527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.464445 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1353/2737] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:19:38.469536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:38.479372 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4050de-056b-4c69-91f5-1bd68ed7224c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:38.484300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:38.484921 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.485205 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.485496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.486184 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:38.488207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.590333 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1385/2738] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:19:38 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:38.595531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:38.607922 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf921d-40aa-4b5e-a6c0-4df566874c8b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:38.683379 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:38.684070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.684894 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.685278 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.686022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:38.688037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.768462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1354/2739] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:19:38 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:38.770281 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:38.781978 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab373-ec8b-4ce3-9831-ad3e15e2e15d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:38.793381 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:38.794157 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.794553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.794956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.796096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:38.799262 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.817767 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1386/2740] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:38.821909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:38.834156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeee96-9f58-4bd0-9793-12b059f65fce admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:38.839405 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0912f-c4c0-42b5-91b5-0a27d69ee8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:38.840005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0912f-c4c0-42b5-91b5-0a27d69ee8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.844391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0912f-c4c0-42b5-91b5-0a27d69ee8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.844391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0912f-c4c0-42b5-91b5-0a27d69ee8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.844391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0912f-c4c0-42b5-91b5-0a27d69ee8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:38.844391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0912f-c4c0-42b5-91b5-0a27d69ee8ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.855221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1355/2741] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:38.861926 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:38.876037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac1d6-5e6f-4b33-9487-2cd9707a1e01 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:38.882704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:38.883663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.884072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.884576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] PATH_INFO: `/v3/projects/1c00af3d239247e9b48598e1208dfe59/users/81bf3d855b854b06aae4ddc3e986ed56/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:38.905095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00af3d239247e9b48598e1208dfe59, user_id=81bf3d855b854b06aae4ddc3e986ed56, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:38.907876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:38.983140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1387/2742] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:19:38 2022] PUT /identity/v3/projects/1c00af3d239247e9b48598e1208dfe59/users/81bf3d855b854b06aae4ddc3e986ed56/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:38.996139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:38.996431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:38.997242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:39.028313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] MFA Rules not processed for user `81bf3d855b854b06aae4ddc3e986ed56`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:39.029605 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:39.105929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1356/2743] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:39.118567 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:39.120493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:39.144120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:39.183697 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d767f34-96e2-4848-9598-acaac030f6ab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:39.188300 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0430054-6854-4924-a595-50bb939c1f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:39.192485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430054-6854-4924-a595-50bb939c1f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:39.192485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430054-6854-4924-a595-50bb939c1f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:39.192485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0430054-6854-4924-a595-50bb939c1f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:39.200096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430054-6854-4924-a595-50bb939c1f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:39.201572 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0430054-6854-4924-a595-50bb939c1f9c service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:39.213552 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1388/2744] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:44.382899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:44.402553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:44.451792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c653a-a0db-49a7-bb92-c949e2a0e078 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:44.473240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:44.473240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:44.473240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:44.473240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] PATH_INFO: `/v3/users/81bf3d855b854b06aae4ddc3e986ed56` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:44.473653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bf3d855b854b06aae4ddc3e986ed56)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:44.473653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:44.656253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bf3d855b854b06aae4ddc3e986ed56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:44.656840 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bf3d855b854b06aae4ddc3e986ed56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:44.669131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bf3d855b854b06aae4ddc3e986ed56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:44.727208 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bf3d855b854b06aae4ddc3e986ed56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:44.727822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bf3d855b854b06aae4ddc3e986ed56'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:44.741462 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1357/2745] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:19:44 2022] DELETE /identity/v3/users/81bf3d855b854b06aae4ddc3e986ed56 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:44.746037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:44.746530 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:44.746659 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:44.767143 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:44.768354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:44.835323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1389/2746] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:44.845492 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:44.846982 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:44.906798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28a98-c0d2-45cb-8e14-3f829e75de27 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:44.910345 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f72da-58d3-4840-a15f-b1d9e3a6d127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:44.910946 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f72da-58d3-4840-a15f-b1d9e3a6d127 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:44.911227 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f72da-58d3-4840-a15f-b1d9e3a6d127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:44.911498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f72da-58d3-4840-a15f-b1d9e3a6d127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:44.920377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f72da-58d3-4840-a15f-b1d9e3a6d127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:44.921795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f72da-58d3-4840-a15f-b1d9e3a6d127 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:44.931042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1358/2747] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:45.383915 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:45.385400 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:45.397602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d22e01-535e-49b6-a8bc-8dd5006e4235 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:45.402269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:45.402954 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:45.403210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:45.403479 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] PATH_INFO: `/v3/projects/1c00af3d239247e9b48598e1208dfe59` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:45.404757 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c00af3d239247e9b48598e1208dfe59)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:45.406709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:45.525594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c00af3d239247e9b48598e1208dfe59', 'request_id': 'req-a665af3b-54c1-4d63-a188-ab600d6ef05e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:45.532662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c00af3d239247e9b48598e1208dfe59', 'request_id': 'req-a665af3b-54c1-4d63-a188-ab600d6ef05e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:45.618520 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c00af3d239247e9b48598e1208dfe59', 'request_id': 'req-a665af3b-54c1-4d63-a188-ab600d6ef05e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:45.629746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] The token cache is being invalidate because project 1c00af3d239247e9b48598e1208dfe59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:19:45.630066 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:45.630739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a665af3b-54c1-4d63-a188-ab600d6ef05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:19:45.632246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1390/2748] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:19:45 2022] DELETE /identity/v3/projects/1c00af3d239247e9b48598e1208dfe59 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:45.637305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:45.637827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:45.637827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:45.658977 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:45.660916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:45.703099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:45.732743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1359/2749] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:45.740596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:45.740886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:45.741169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:45.761535 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:45.762810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:45.770993 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1391/2750] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:45.775735 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:45.787012 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286f1c-5c1a-4e29-bba3-be8e18d63527 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:45.791828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:45.792518 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:45.792801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:45.793074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:45.794380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:19:45.794683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:45.796289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:45.808453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1360/2751] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:19:45.812911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:45.822351 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c91b5-9bd7-47b3-9d57-2d63482f98cb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:45.827684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:45.829297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:45.829297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:45.829297 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:45.829565 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:45.831396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:45.916853 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1392/2752] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:19:45 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:45.921366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:45.931648 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4f09c-12c3-4311-9b15-327782dec4e4 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:45.992044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:45.992557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:45.992839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:45.993111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:45.993730 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:45.995677 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:46.110164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1361/2753] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:19:45 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:19:46.114411 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:46.129829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdb2bb-a19f-4ae6-ab66-27ea33d307ea admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:46.134683 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:46.135285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:46.135564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:46.135839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:46.136486 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:46.138649 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:46.149053 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1393/2754] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:46.153790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:46.164138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d087-618f-43e7-99df-71877655d1ba admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:46.168768 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7df3-b44a-48b3-852d-bab88e99d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:46.169373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7df3-b44a-48b3-852d-bab88e99d81b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:46.169657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7df3-b44a-48b3-852d-bab88e99d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:46.169970 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7df3-b44a-48b3-852d-bab88e99d81b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:46.170642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f7df3-b44a-48b3-852d-bab88e99d81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:46.172243 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f7df3-b44a-48b3-852d-bab88e99d81b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:46.183506 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1362/2755] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:19:46.188938 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:46.202064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397870b5-0ff2-4997-9b2f-8a9fad5de8ae admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:46.206995 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:46.207689 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:46.207972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:46.208249 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] PATH_INFO: `/v3/projects/e4505a4333184ea88a51dd6da34a1e32/users/1dc5b8ed536e45669a56d20d05b0fe2d/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:46.210933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:46.225589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4505a4333184ea88a51dd6da34a1e32, user_id=1dc5b8ed536e45669a56d20d05b0fe2d, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:46.228528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:46.307894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1394/2756] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:19:46 2022] PUT /identity/v3/projects/e4505a4333184ea88a51dd6da34a1e32/users/1dc5b8ed536e45669a56d20d05b0fe2d/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:19:46.313838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c70fa-9b13-4ed3-a967-b0df867e1641 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:46.314301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c70fa-9b13-4ed3-a967-b0df867e1641 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:46.314812 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c70fa-9b13-4ed3-a967-b0df867e1641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:46.334625 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-de4c70fa-9b13-4ed3-a967-b0df867e1641 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:46.335823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-de4c70fa-9b13-4ed3-a967-b0df867e1641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:46.397005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1363/2757] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:46.407320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:46.409110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:46.469606 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ef75e-9fb0-4bdc-86c7-7db553df3bae admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:46.473744 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:46.474408 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:46.474691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:46.474966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:46.485587 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:46.487075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:46.497123 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1395/2758] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:47.722478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fd93-ea41-4016-a008-aac7aff2b89f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:47.722947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fd93-ea41-4016-a008-aac7aff2b89f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:47.723057 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fd93-ea41-4016-a008-aac7aff2b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:47.753998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-a9c3fd93-ea41-4016-a008-aac7aff2b89f None None] MFA Rules not processed for user `1dc5b8ed536e45669a56d20d05b0fe2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:47.755498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a9c3fd93-ea41-4016-a008-aac7aff2b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:47.796031 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:47.831907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1364/2759] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:47.842781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:47.844355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:47.900327 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2649f-5a30-49de-bec7-bae18c47396b service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:47.903889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:47.904478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:47.904755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:47.905026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:47.913339 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:47.914855 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:47.923753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1396/2760] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:50.739877 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:50.740421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:50.740421 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:50.761088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] MFA Rules not processed for user `1dc5b8ed536e45669a56d20d05b0fe2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:19:50.762334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:50.769871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1365/2761] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:19:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:19:51.013321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:51.015149 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:51.027967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd874-ed52-4c77-932d-5b951d006e46 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:51.032335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:51.033025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:51.033302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:51.033580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:51.035370 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:51.046843 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:51.048284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:51.057185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1397/2762] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:19:52.457274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:52.458963 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:52.535070 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab6529-de16-41d3-85f3-6e85f7ab84dd None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:52.541459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:52.542103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:52.542408 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:52.542671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:52.545048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:52.557752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:52.559431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:52.570698 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1366/2763] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:19:59.778751 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:19:59.780946 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:59.861096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5028615-7350-41d4-ade6-836662f47cab service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:19:59.866966 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:19:59.867672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:19:59.869119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:19:59.869119 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:19:59.870117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:19:59.883473 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:19:59.885064 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b4a6-3bdb-444f-990d-baf8a734296b service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:19:59.891936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:19:59.897326 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1398/2764] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:20:02.565706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=46 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:07.969291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:20:07.984910 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04d981-fe7a-4092-84e3-b4cc882195b1 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:20:07.991128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:20:07.991992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:07.992185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:07.992355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:07.994139 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:20:08.007320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:20:08.008981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03bb62-2306-4385-ace0-b28404fa6790 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:20:08.021388 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1367/2765] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:20:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:20:16.965980 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:16.966482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:16.966595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:16.985651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] MFA Rules not processed for user `1dc5b8ed536e45669a56d20d05b0fe2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:20:16.986897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:20:16.993662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1399/2766] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:20:18.015944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:26.980323 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:40.227883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936297-9617-4ca6-bec6-3cc3ad524b26 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:40.228389 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936297-9617-4ca6-bec6-3cc3ad524b26 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:40.228501 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61936297-9617-4ca6-bec6-3cc3ad524b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:40.281909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-61936297-9617-4ca6-bec6-3cc3ad524b26 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:20:40.283136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-61936297-9617-4ca6-bec6-3cc3ad524b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:20:40.350951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1368/2767] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Oct 10 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:20:40.540136 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:20:40.541795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:20:40.636106 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bd02e-13ef-4937-8637-6490292f8ae2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:20:40.641054 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1835fd7-d3ee-4ab5-aacb-d0db96e57115 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:20:40.648375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835fd7-d3ee-4ab5-aacb-d0db96e57115 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:40.648375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835fd7-d3ee-4ab5-aacb-d0db96e57115 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:40.648375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1835fd7-d3ee-4ab5-aacb-d0db96e57115 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:40.650968 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1835fd7-d3ee-4ab5-aacb-d0db96e57115 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:20:40.652546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1835fd7-d3ee-4ab5-aacb-d0db96e57115 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:20:40.660549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1400/2768] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:20:50.347052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=40 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:50.657347 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=41 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:20:51.309085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:51.309622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:51.310201 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:51.332519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] MFA Rules not processed for user `bcb483963ba446d6ae45064ca5c357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:20:51.333781 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:20:51.398323 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1369/2769] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:20:57.863178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:57.863781 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:57.864031 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:57.886491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] MFA Rules not processed for user `866d752ffa524c449a285cf975b21d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:20:57.888117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:20:57.896040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1401/2770] 10.222.0.47 () {58 vars in 967 bytes} [Mon Oct 10 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:20:57.908639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:20:57.921538 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73629ca4-903d-4e81-86be-cfb4be73835a None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:20:57.927464 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6738164d722a43c7b32706caef761fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:20:57.928140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:20:57.928419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:20:57.928692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:20:57.939106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:20:57.940731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:20:57.950489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1370/2771] 10.222.0.47 () {60 vars in 1384 bytes} [Mon Oct 10 12:20:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 12:21:01.418913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:01.431848 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2873f-81e9-4bd0-bddc-3aa41decf8e9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:01.436536 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:01.437167 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:01.437444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:01.437715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] PATH_INFO: `/v3/users/1dc5b8ed536e45669a56d20d05b0fe2d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:01.438861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc5b8ed536e45669a56d20d05b0fe2d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:01.440784 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:01.654265 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc5b8ed536e45669a56d20d05b0fe2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:01.654831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc5b8ed536e45669a56d20d05b0fe2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:01.662155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc5b8ed536e45669a56d20d05b0fe2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:01.675227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc5b8ed536e45669a56d20d05b0fe2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:01.765923 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-67044e40-cb9d-4afd-9f6e-96e391c1ca0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc5b8ed536e45669a56d20d05b0fe2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:01.772366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1402/2772] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:21:01 2022] DELETE /identity/v3/users/1dc5b8ed536e45669a56d20d05b0fe2d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:21:02.013291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.028286 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e93c-93db-4ffc-8282-20f03d783485 service swift] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.089330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.090022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.090307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.090584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] PATH_INFO: `/v3/projects/e4505a4333184ea88a51dd6da34a1e32` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.091761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4505a4333184ea88a51dd6da34a1e32)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.093690 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:02.215780 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4505a4333184ea88a51dd6da34a1e32', 'request_id': 'req-3d91e319-c335-4455-8585-9bc2a7907e78'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:02.223147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4505a4333184ea88a51dd6da34a1e32', 'request_id': 'req-3d91e319-c335-4455-8585-9bc2a7907e78'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:02.280124 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4505a4333184ea88a51dd6da34a1e32', 'request_id': 'req-3d91e319-c335-4455-8585-9bc2a7907e78'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:02.295525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] The token cache is being invalidate because project e4505a4333184ea88a51dd6da34a1e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:21:02.295996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:02.296659 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-3d91e319-c335-4455-8585-9bc2a7907e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:02.298214 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1371/2773] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:21:02 2022] DELETE /identity/v3/projects/e4505a4333184ea88a51dd6da34a1e32 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:21:02.303413 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.308403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.308403 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.331603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:02.331603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:02.395155 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1403/2774] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:02.458756 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.459047 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.459321 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.480419 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:02.481611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:02.490505 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1372/2775] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:02.494854 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.504558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc9ef-99a8-42e0-96ec-d8b0bdccd0e2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.508989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.509580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.509879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.510152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.510791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:21:02.511086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.512655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:02.524336 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1404/2776] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:21:02.528595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.538335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939d418-d438-4ce0-8afb-52e41a7f6050 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.542956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.543551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.543831 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.544117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.544727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.546679 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:02.562262 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:02.682446 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1373/2777] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:21:02 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:21:02.686379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.696271 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264ecc-824a-41ba-ba8b-0abb72b4a05b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.746633 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:02.755445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.756095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.756376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.756646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.757270 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.759207 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:02.858032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1405/2778] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:21:02 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:21:02.862384 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.873889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182404c-8499-485d-9cc4-202345f813d3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.878716 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.879326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.879607 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.879886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.880530 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.882198 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:02.892385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1374/2779] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:21:02.897194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.912128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc74f-d0f7-4424-af5d-4db83be2a3c5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.917122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a88f1-191b-4725-9501-33b4c829052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.919469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a88f1-191b-4725-9501-33b4c829052e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.919469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a88f1-191b-4725-9501-33b4c829052e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.919469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a88f1-191b-4725-9501-33b4c829052e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.919469 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a88f1-191b-4725-9501-33b4c829052e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.920505 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a88f1-191b-4725-9501-33b4c829052e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:02.931640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1406/2780] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:21:02.935822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:02.945879 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd8dd4-ac25-4562-979d-02376c010dad admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:02.950712 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:02.951355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:02.951640 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:02.951918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] PATH_INFO: `/v3/projects/4a17a2110e3c4705ac1b72bc8f6d7386/users/fe2eb1e70ace457fa160ddc8b62f0ee7/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:02.967259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a17a2110e3c4705ac1b72bc8f6d7386, user_id=fe2eb1e70ace457fa160ddc8b62f0ee7, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:02.969971 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:03.030704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1375/2781] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:21:02 2022] PUT /identity/v3/projects/4a17a2110e3c4705ac1b72bc8f6d7386/users/fe2eb1e70ace457fa160ddc8b62f0ee7/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:21:03.040517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:03.040804 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:03.041076 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:03.068670 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] MFA Rules not processed for user `fe2eb1e70ace457fa160ddc8b62f0ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:03.069904 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:03.136112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1407/2782] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:03.148330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:03.150081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:03.235180 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083ac1-a230-4702-a2fa-bba104741d78 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:03.239034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a1bda85ce4a41ed8ec354d40ecbb08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:03.239697 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:03.239949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:03.240239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:03.249196 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:03.250728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:03.260584 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1376/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:21:08.229287 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:08.231171 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:08.337821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b48f88-8d21-48d0-bed2-ec0e439f36ae None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:08.344120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:08.344765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:08.345059 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:08.345362 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:08.347380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:08.362615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:08.363740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:08.376068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1408/2784] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:21:13.256531 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:INSERT=2,keystone:SELECT=52 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:18.370589 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:27.312515 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:27.314671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:27.389005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d5fd-e6cc-4bae-9980-ad22998e23b9 service glance] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:27.395143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:27.395766 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:27.396043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:27.396313 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:27.398283 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:27.410886 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:27.412556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857490-24d5-453a-b7da-a06f3ba0146c service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:27.424181 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1377/2785] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:21:35.049562 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:35.121512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4b40c-7818-458b-a41c-c440f38174f4 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:35.126328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:35.127728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:35.128007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:35.128276 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] PATH_INFO: `/v3/users/fe2eb1e70ace457fa160ddc8b62f0ee7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:35.129474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2eb1e70ace457fa160ddc8b62f0ee7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:35.131461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:35.337899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2eb1e70ace457fa160ddc8b62f0ee7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:35.338555 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2eb1e70ace457fa160ddc8b62f0ee7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:35.347760 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2eb1e70ace457fa160ddc8b62f0ee7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:35.361717 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2eb1e70ace457fa160ddc8b62f0ee7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:35.482354 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2eb1e70ace457fa160ddc8b62f0ee7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:35.489464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1409/2786] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:21:35 2022] DELETE /identity/v3/users/fe2eb1e70ace457fa160ddc8b62f0ee7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:21:35.494116 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:35.497189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:35.497189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:35.513532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:35.514770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:35.589738 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1378/2787] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:35.601458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:35.602907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:35.666969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae9caa-b693-4428-b564-2b3dadafba01 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:35.670811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1530ac-b883-4a39-86f9-708efc341bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:35.671428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1530ac-b883-4a39-86f9-708efc341bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:35.671696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1530ac-b883-4a39-86f9-708efc341bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:35.671973 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1530ac-b883-4a39-86f9-708efc341bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:35.682034 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1530ac-b883-4a39-86f9-708efc341bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:35.683525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1530ac-b883-4a39-86f9-708efc341bf6 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:35.694227 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1410/2788] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:21:36.150850 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:36.152516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:36.168024 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e796-c144-44c7-be37-19309908e0b1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:36.173335 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:36.174566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.174849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.175129 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] PATH_INFO: `/v3/projects/4a17a2110e3c4705ac1b72bc8f6d7386` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.176456 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a17a2110e3c4705ac1b72bc8f6d7386)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:36.178488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:36.316770 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a17a2110e3c4705ac1b72bc8f6d7386', 'request_id': 'req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:36.325348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a17a2110e3c4705ac1b72bc8f6d7386', 'request_id': 'req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:36.457693 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a17a2110e3c4705ac1b72bc8f6d7386', 'request_id': 'req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:36.473658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] The token cache is being invalidate because project 4a17a2110e3c4705ac1b72bc8f6d7386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:21:36.474001 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:36.474672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-0ead9c7c-6929-4d3f-a4d5-09f751b59fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:21:36.476193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1379/2789] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:21:36 2022] DELETE /identity/v3/projects/4a17a2110e3c4705ac1b72bc8f6d7386 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:21:36.482200 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.482805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.482910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.507190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:36.508477 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:36.528948 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:36.582061 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1411/2790] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:36.592701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.593291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.593291 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.616178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:36.617486 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:36.626225 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1380/2791] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:36.631449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:36.641678 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6241c36-5cc1-49b7-9dd9-16bd617628a3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:36.646690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:36.647315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.647607 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.647875 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.648582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:21:36.648835 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:36.650551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:36.663846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1412/2792] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:21:36.669002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:36.681235 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2630a-d310-412b-adca-e0f0f7cd0b6f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:36.686997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:36.687672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.687955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.688228 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.689571 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:36.691554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:36.696989 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:36.788565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1381/2793] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:21:36 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:21:36.793128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:36.804078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171587e-5ebd-455f-a2d8-de995c04aac7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:36.870647 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:36.871330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.871690 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.872051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.873042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:36.876132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:36.969017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1413/2794] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:21:36 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:21:36.973424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:36.984585 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea30089-3023-4d75-a3c0-eeadf0146b16 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:36.989575 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:36.990240 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:36.990551 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:36.990805 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:36.991465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:36.993097 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:37.004871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1382/2795] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:21:37.009315 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:37.020694 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344841-7aaf-4f1c-8054-d86e85e25182 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:37.026261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef06d6-1025-4b03-b88f-d17877b78f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:37.026884 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef06d6-1025-4b03-b88f-d17877b78f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:37.027162 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef06d6-1025-4b03-b88f-d17877b78f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:37.027431 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef06d6-1025-4b03-b88f-d17877b78f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:37.028095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef06d6-1025-4b03-b88f-d17877b78f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:37.029829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef06d6-1025-4b03-b88f-d17877b78f2f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:37.042197 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1414/2796] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:21:37.048969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:37.059587 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d35f-1ae2-44ce-9431-0c082ff64629 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:37.064942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:37.065608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:37.065909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:37.066184 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] PATH_INFO: `/v3/projects/578d2c7687024d498043b71997c6fd0f/users/e1e4a1eef3e34218acb8bfa8548fe0e5/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:37.083789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] RBAC: Authorizing `identity:create_grant(project_id=578d2c7687024d498043b71997c6fd0f, user_id=e1e4a1eef3e34218acb8bfa8548fe0e5, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:37.086802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:37.209134 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1383/2797] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:21:37 2022] PUT /identity/v3/projects/578d2c7687024d498043b71997c6fd0f/users/e1e4a1eef3e34218acb8bfa8548fe0e5/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:21:37.215223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443858c-e9fa-4184-9d69-7515615ec33e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:37.215655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443858c-e9fa-4184-9d69-7515615ec33e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:37.216075 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443858c-e9fa-4184-9d69-7515615ec33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:37.237962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6443858c-e9fa-4184-9d69-7515615ec33e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:37.239222 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6443858c-e9fa-4184-9d69-7515615ec33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:37.321007 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1415/2798] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:37.332050 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:37.333893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:37.399281 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc525-a64d-4928-b391-5ba22572461a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:37.403108 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:37.403983 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:37.404175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:37.404453 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:37.415282 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:37.416823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:37.428105 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1384/2799] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:21:38.938392 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d0f7-9fc3-4a92-973c-c9c93a32463a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:38.939828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d0f7-9fc3-4a92-973c-c9c93a32463a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:38.939828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7d0f7-9fc3-4a92-973c-c9c93a32463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:38.987345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e2e7d0f7-9fc3-4a92-973c-c9c93a32463a None None] MFA Rules not processed for user `e1e4a1eef3e34218acb8bfa8548fe0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:38.989598 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e2e7d0f7-9fc3-4a92-973c-c9c93a32463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:39.018917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:39.093841 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1416/2800] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:39.106796 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:39.108459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:39.178600 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6360b-0d10-4b21-89b6-45a7a8e7567c service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:39.182563 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:39.183329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:39.183707 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:39.184084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:39.193790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:39.195437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:39.205601 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1385/2801] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:21:41.139950 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944300-00a8-4dc9-afca-6374f2fa7d05 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:41.140525 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944300-00a8-4dc9-afca-6374f2fa7d05 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:41.145236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944300-00a8-4dc9-afca-6374f2fa7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:41.164735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-80944300-00a8-4dc9-afca-6374f2fa7d05 None None] MFA Rules not processed for user `e1e4a1eef3e34218acb8bfa8548fe0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:21:41.166808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-80944300-00a8-4dc9-afca-6374f2fa7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:41.178545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1417/2802] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:21:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:21:41.438543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:21:41.440216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:41.453535 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9d0d-f86e-4eee-8193-edad55a64933 service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:21:41.457949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:21:41.458573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:21:41.458852 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:21:41.459274 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:21:41.461166 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:21:41.472746 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:21:41.474247 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:21:41.483863 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1386/2803] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:21:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:21:51.156318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=22 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:21:51.479396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:22:21.363496 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193bef5-a1f5-4d29-be1f-48fae967e11b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:21.364117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193bef5-a1f5-4d29-be1f-48fae967e11b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:21.364117 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193bef5-a1f5-4d29-be1f-48fae967e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:21.385379 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d193bef5-a1f5-4d29-be1f-48fae967e11b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:21.386691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d193bef5-a1f5-4d29-be1f-48fae967e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:21.394990 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1418/2804] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:21.420592 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:22:21.422083 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:21.500729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6d1d0-2479-4b9f-8399-4d8ebca1f5ac service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:22:21.506325 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:22:21.506944 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:21.507230 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:21.507516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:21.516904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:22:21.518621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:22:21.529358 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1387/2805] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:22:26.733929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02955fb-1f20-4250-8242-e83099a789e2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:26.734545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02955fb-1f20-4250-8242-e83099a789e2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:26.734545 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02955fb-1f20-4250-8242-e83099a789e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:26.754920 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a02955fb-1f20-4250-8242-e83099a789e2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:26.756195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a02955fb-1f20-4250-8242-e83099a789e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:26.765069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1419/2806] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:26.806111 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:22:26.807827 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:26.829356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2081d-03a4-4148-ac80-975ecdc566c9 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:22:26.836709 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:22:26.838025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:26.838307 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:26.838581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:26.847742 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:22:26.849348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:22:26.860995 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1388/2807] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:22:31.286686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9365c-02b7-4e90-a26f-251a39eb9a70 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:31.287355 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9365c-02b7-4e90-a26f-251a39eb9a70 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:31.291056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9365c-02b7-4e90-a26f-251a39eb9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:31.310840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-21f9365c-02b7-4e90-a26f-251a39eb9a70 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:31.312051 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-21f9365c-02b7-4e90-a26f-251a39eb9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:31.320072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1420/2808] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:31.342476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:22:31.354231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ab94-06c8-4643-904b-0ec48d6778bb service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:22:31.359749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:22:31.361701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:31.361701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:31.361701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:31.369356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:22:31.370980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:22:31.380897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1389/2809] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:22:35.171395 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648f33-22b4-4969-b541-ce1357433b9c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:35.172018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648f33-22b4-4969-b541-ce1357433b9c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:35.172018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648f33-22b4-4969-b541-ce1357433b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:35.192499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-55648f33-22b4-4969-b541-ce1357433b9c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:35.193706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55648f33-22b4-4969-b541-ce1357433b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:35.201655 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1421/2810] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:35.240470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:22:35.253106 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f039-ef1e-431e-919c-683b65b21e96 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:22:35.258981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:22:35.259583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:35.259865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:35.260138 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:35.270021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:22:35.271683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:22:35.283537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1390/2811] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:22:40.556026 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ae778-e655-4895-badc-79d2aa572986 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:40.556892 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ae778-e655-4895-badc-79d2aa572986 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:40.557085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ae778-e655-4895-badc-79d2aa572986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:40.597551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4e0ae778-e655-4895-badc-79d2aa572986 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:40.597551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4e0ae778-e655-4895-badc-79d2aa572986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:40.599199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1422/2812] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:40.620200 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:22:40.633703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba323fc-9151-4064-86e5-6b32aaf3298b service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:22:40.640490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:22:40.641117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:40.641410 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:40.641689 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:40.651502 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:22:40.653113 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:22:40.663557 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1391/2813] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:22:44.784209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563e80-2bb7-4f6a-9322-162d4ad1a2df None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:44.784782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563e80-2bb7-4f6a-9322-162d4ad1a2df None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:44.784782 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563e80-2bb7-4f6a-9322-162d4ad1a2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:44.803965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-33563e80-2bb7-4f6a-9322-162d4ad1a2df None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:44.805158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-33563e80-2bb7-4f6a-9322-162d4ad1a2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:44.812838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1423/2814] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:44.841033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:22:44.849657 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=59 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:22:44.856503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa5261-d50e-448a-837a-318c7d1a21cc service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:22:44.862314 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773751c-a19f-41d1-b71b-849b1ed18b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:22:44.862921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773751c-a19f-41d1-b71b-849b1ed18b24 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:44.863205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773751c-a19f-41d1-b71b-849b1ed18b24 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:44.863480 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773751c-a19f-41d1-b71b-849b1ed18b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:44.871980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773751c-a19f-41d1-b71b-849b1ed18b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:22:44.873554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773751c-a19f-41d1-b71b-849b1ed18b24 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:22:44.882978 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1392/2815] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:22:52.871998 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4cea7-8fc3-4906-a1d0-e0468eefc199 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:22:52.872445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4cea7-8fc3-4906-a1d0-e0468eefc199 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:22:52.872445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4cea7-8fc3-4906-a1d0-e0468eefc199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:22:52.879972 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=19 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:22:52.892068 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-19b4cea7-8fc3-4906-a1d0-e0468eefc199 None None] MFA Rules not processed for user `bcb483963ba446d6ae45064ca5c357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:22:52.893268 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-19b4cea7-8fc3-4906-a1d0-e0468eefc199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:22:52.951058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1424/2816] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:22:54.891719 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:02.943662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=24 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:03.259537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:03.260144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:03.260144 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:03.282547 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] MFA Rules not processed for user `e1e4a1eef3e34218acb8bfa8548fe0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:23:03.283799 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:03.290988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1393/2817] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:23:13.275268 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:22.327032 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddbdc-59f9-4616-87ef-1220e1dcf25a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:22.327698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddbdc-59f9-4616-87ef-1220e1dcf25a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:22.327698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ddbdc-59f9-4616-87ef-1220e1dcf25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:22.347511 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-573ddbdc-59f9-4616-87ef-1220e1dcf25a None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:23:22.348735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-573ddbdc-59f9-4616-87ef-1220e1dcf25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:22.356725 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1425/2818] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:23:22.387403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:23:22.400897 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163a8a-1181-4c78-8d23-7c939e194540 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:23:22.406928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:23:22.407608 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:22.407889 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:22.408169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:22.417549 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:23:22.419326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:23:22.431202 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1394/2819] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:23:27.717524 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add8d05-46a2-4c4b-b6fc-cb6bbae4d975 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:27.718125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add8d05-46a2-4c4b-b6fc-cb6bbae4d975 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:27.718125 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add8d05-46a2-4c4b-b6fc-cb6bbae4d975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:27.737828 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6add8d05-46a2-4c4b-b6fc-cb6bbae4d975 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:23:27.739055 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6add8d05-46a2-4c4b-b6fc-cb6bbae4d975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:27.746897 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1426/2820] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:23:27.770058 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:23:27.781573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36936c-7be0-4f38-badc-fa6c060d5aea service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:23:27.787135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:23:27.787727 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:27.788011 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:27.788288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:27.796653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:23:27.798259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:23:27.807941 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1395/2821] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:23:31.550246 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21398e8-33ac-4249-bf5b-edfc9c1c47c2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:31.550799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21398e8-33ac-4249-bf5b-edfc9c1c47c2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:31.550799 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21398e8-33ac-4249-bf5b-edfc9c1c47c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:31.571217 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b21398e8-33ac-4249-bf5b-edfc9c1c47c2 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:23:31.572430 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b21398e8-33ac-4249-bf5b-edfc9c1c47c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:31.580465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1427/2822] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:23:31.609021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:23:31.621972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc4e52-2cdb-43ee-ae4a-6c18a4d537a9 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:23:31.627496 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:23:31.628099 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:31.628413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:31.628687 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:31.637612 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:23:31.639252 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:23:31.649938 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1396/2823] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:23:35.848294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea9aa-735f-4cb0-824e-7dcaf0a08f8f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:35.848913 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea9aa-735f-4cb0-824e-7dcaf0a08f8f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:35.849284 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ea9aa-735f-4cb0-824e-7dcaf0a08f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:35.881112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-342ea9aa-735f-4cb0-824e-7dcaf0a08f8f None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:23:35.883081 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-342ea9aa-735f-4cb0-824e-7dcaf0a08f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:35.893349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1428/2824] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:23:35.917465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:23:35.929463 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c78297-9769-4a64-8803-3da46bec5e70 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:23:35.935814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:23:35.936470 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:35.936809 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:35.937088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:35.947484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:23:35.949096 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:23:35.960560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1397/2825] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:23:40.067386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:40.067932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:40.067932 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:40.088412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:23:40.089616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:40.098023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1429/2826] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Oct 10 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:23:40.144597 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:23:40.156782 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e08fe-ef58-43dd-ae8b-ad7897e8730b service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:23:40.163133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:23:40.163736 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:40.164021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:40.164300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:40.172818 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:23:40.174437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:23:40.183972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1398/2827] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:23:44.204988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:23:44.207723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:44.214179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=16 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:44.219847 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59617393-ecb1-422a-85b0-0d85bfb78d67 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:23:44.223472 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:23:44.224079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:23:44.224384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:23:44.225294 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:23:44.227096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:23:44.241961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:23:44.243418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:23:44.255688 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1430/2828] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:23:50.179802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=30 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:23:54.250691 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:24:16.626183 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:24:16.627609 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:16.699955 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797116b-b9c8-479c-b266-83524722c9c6 service nova] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:24:16.704872 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:24:16.713385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:16.713385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:16.713385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:16.713385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:16.719322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:24:16.720904 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:24:16.732940 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1399/2829] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:24:16.799616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:24:16.804130 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3281-03f2-481d-883d-ca217f5f384a service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:24:16.809451 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:24:16.810127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:16.810404 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:16.810676 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] PATH_INFO: `/v3/users/e1e4a1eef3e34218acb8bfa8548fe0e5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:16.811801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e4a1eef3e34218acb8bfa8548fe0e5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:24:16.813726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:24:17.017809 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e4a1eef3e34218acb8bfa8548fe0e5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.018601 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e4a1eef3e34218acb8bfa8548fe0e5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.026886 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e4a1eef3e34218acb8bfa8548fe0e5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.041199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e4a1eef3e34218acb8bfa8548fe0e5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.118573 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e4a1eef3e34218acb8bfa8548fe0e5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.125808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1431/2830] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:24:16 2022] DELETE /identity/v3/users/e1e4a1eef3e34218acb8bfa8548fe0e5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:24:17.365834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:24:17.376725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824845-71e4-48e9-8d45-c38ad1276968 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:24:17.435053 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:24:17.435823 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:17.436103 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:17.436376 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] PATH_INFO: `/v3/projects/578d2c7687024d498043b71997c6fd0f` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:17.437509 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578d2c7687024d498043b71997c6fd0f)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:24:17.439437 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:24:17.551457 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578d2c7687024d498043b71997c6fd0f', 'request_id': 'req-94c8f79d-bdf8-40c3-9cf2-65182db79e68'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.558574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578d2c7687024d498043b71997c6fd0f', 'request_id': 'req-94c8f79d-bdf8-40c3-9cf2-65182db79e68'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.650248 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578d2c7687024d498043b71997c6fd0f', 'request_id': 'req-94c8f79d-bdf8-40c3-9cf2-65182db79e68'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.661398 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] The token cache is being invalidate because project 578d2c7687024d498043b71997c6fd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:24:17.664451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.664451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:24:17.664451 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1400/2831] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:24:17 2022] DELETE /identity/v3/projects/578d2c7687024d498043b71997c6fd0f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:24:27.122079 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:24:27.658098 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:24:31.780768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:24:31.782223 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:31.861444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32584a8-c3a7-4a11-8bd2-86abd7683788 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:24:31.928965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:24:31.929577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:31.929887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:31.930159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:31.931918 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:31.992193 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:24:31.993779 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec41c9b-6013-4641-a8f7-e145f195b72e service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:24:32.002672 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1432/2832] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:24:33.849253 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:24:33.850692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:33.907733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f79d-bdf8-40c3-9cf2-65182db79e68 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:24:33.911637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:24:33.912234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:33.912513 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:33.912787 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:33.914537 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:33.928418 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:24:33.929838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:24:33.941705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1401/2833] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:24:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:24:41.998594 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:24:43.936550 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=26 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:24:47.954190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:47.954752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:47.954752 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:47.974632 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] MFA Rules not processed for user `bcb483963ba446d6ae45064ca5c357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:24:47.975838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:47.982818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1433/2834] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:24:51.744867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:24:51.746341 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:51.802622 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b61e-dd4f-4d8a-9cd9-0691a16d5dae service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:24:51.806178 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:24:51.806775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:24:51.807102 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:24:51.807331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:24:51.809026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:24:51.818503 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:24:51.819913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:24:51.828131 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1402/2835] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:24:57.969021 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:25:01.824701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=26 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:28.232666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:28.234561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:28.334988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf40d3c-a3a9-4b16-9c46-b0c744d5e6cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:28.341462 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6384fbfdbff1461594e0e4f877bc8e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:28.342277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:28.342715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:28.343090 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:28.345018 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:28.360503 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:28.362396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:28.377013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1434/2836] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:28.685136 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:28.686694 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:28.811212 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33e4e-e3ba-4adc-a342-b644329b7ed8 service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:28.817002 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:28.817631 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:28.817936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:28.818209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:28.819962 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:28.832765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:28.835033 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:28.846193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1403/2837] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:26:35.212229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:35.213695 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:35.226052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934db5-8f77-473a-89d9-fd893abe321b service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:35.229634 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:35.230259 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:35.230534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:35.230798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:35.232453 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:35.321581 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:35.323045 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:35.341906 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1435/2838] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:38.840839 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=54 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:39.241911 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:39.245633 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:39.262508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb614d60-b108-40a9-bf17-61c444b7d4e8 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:39.268257 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:39.268867 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:39.269155 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:39.269429 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:39.271479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:39.286718 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:39.289702 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:39.299580 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1404/2839] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:39.390867 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:39.393027 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:39.405593 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67820859-4b73-4951-b7a4-80e77a6ecbdf service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:39.410476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:39.411602 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:39.411880 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:39.412179 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] PATH_INFO: `/v3/users/bcb483963ba446d6ae45064ca5c357b1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:39.413288 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb483963ba446d6ae45064ca5c357b1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:39.415225 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:39.610646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb483963ba446d6ae45064ca5c357b1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:39.611382 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb483963ba446d6ae45064ca5c357b1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:39.619261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb483963ba446d6ae45064ca5c357b1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:39.621209 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:39.632394 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb483963ba446d6ae45064ca5c357b1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:39.738449 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a580f27d-c17b-4f52-b85a-9a6af36d875a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb483963ba446d6ae45064ca5c357b1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:39.745092 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1436/2840] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:26:39 2022] DELETE /identity/v3/users/bcb483963ba446d6ae45064ca5c357b1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:39.990740 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.002052 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c73ff-d5c3-44b4-8be2-d6e7fbdab548 service placement] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.062933 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.063565 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.063846 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.064121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] PATH_INFO: `/v3/projects/26b0aee74ef440a3935ee030c4cb9a4c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.065236 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b0aee74ef440a3935ee030c4cb9a4c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.067683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:40.202968 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b0aee74ef440a3935ee030c4cb9a4c', 'request_id': 'req-ecb3af44-4ee2-46df-a269-a93373d62040'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:40.211703 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b0aee74ef440a3935ee030c4cb9a4c', 'request_id': 'req-ecb3af44-4ee2-46df-a269-a93373d62040'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:40.286997 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b0aee74ef440a3935ee030c4cb9a4c', 'request_id': 'req-ecb3af44-4ee2-46df-a269-a93373d62040'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:40.300195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] The token cache is being invalidate because project 26b0aee74ef440a3935ee030c4cb9a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:26:40.300488 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:40.301789 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-ecb3af44-4ee2-46df-a269-a93373d62040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:40.303316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1405/2841] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:26:39 2022] DELETE /identity/v3/projects/26b0aee74ef440a3935ee030c4cb9a4c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:40.308425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.308715 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.308988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.377058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:40.378321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:40.440156 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1437/2842] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:26:40.449133 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.449573 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.450117 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.471331 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:40.472556 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:40.481217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1406/2843] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:40.485640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.496409 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e00e-6e28-44a4-bc09-3c7eef8e421b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.501345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.501984 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.502261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.502532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.503176 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:26:40.503478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.505105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:40.518574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1438/2844] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:26:40.522866 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.532595 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000aae49-518a-4f10-b8ff-0422806b9f3e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.537819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.538449 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.538747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.539020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.539653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.541568 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:40.642913 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1407/2845] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:26:40 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:26:40.647680 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.657730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859a24f-f229-476c-88bc-fa8e408c5f7c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.724873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.725512 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.725807 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.726129 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.726786 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.728735 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:40.819661 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1439/2846] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:26:40 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:40.823857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.835671 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa79b3-935b-4161-bc17-e8b1b6a8e2a8 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.840654 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.844973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.844973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.844973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.844973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.844973 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:40.858091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1408/2847] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:40.862534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.872898 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f57e6f-6e16-46d0-b1be-caac9c79d6aa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.877985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359019e-0636-4903-aca9-b2831c2d2ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.878624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359019e-0636-4903-aca9-b2831c2d2ada admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.878905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359019e-0636-4903-aca9-b2831c2d2ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.879178 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359019e-0636-4903-aca9-b2831c2d2ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.879864 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359019e-0636-4903-aca9-b2831c2d2ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.881495 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359019e-0636-4903-aca9-b2831c2d2ada admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:40.892821 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1440/2848] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:40.897613 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:40.907664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bdb20-5458-4478-b77a-0b7fb988f1c3 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:40.913318 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:40.914009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:40.914294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:40.914566 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] PATH_INFO: `/v3/projects/a07d6d5b6d864095bf9b08a745eeb2c2/users/78272c3bd729409b8a03ac990a6029c5/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:40.931009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07d6d5b6d864095bf9b08a745eeb2c2, user_id=78272c3bd729409b8a03ac990a6029c5, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:40.933663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.059357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1409/2849] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:40 2022] PUT /identity/v3/projects/a07d6d5b6d864095bf9b08a745eeb2c2/users/78272c3bd729409b8a03ac990a6029c5/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:41.070104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.070299 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.070569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.093710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:41.102236 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] MFA Rules not processed for user `78272c3bd729409b8a03ac990a6029c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:41.103455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:41.170091 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1441/2850] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:41.174482 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.190504 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:41.246294 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ffc24-51c0-4dca-ac4a-c6d381b14824 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:41.251217 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:41.251832 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.255329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.255329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.255329 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:41.255721 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.370104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1410/2851] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:26:41 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:41.372146 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.384374 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61fc00-c318-4d41-85b5-ed7de26bb226 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:41.443476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:41.444190 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.444348 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.444623 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.445255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:41.447255 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.562345 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1442/2852] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:26:41 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:41.566567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.578567 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31801ff8-dc03-4c86-80f7-a945e94035f5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:41.584454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:41.585086 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.585370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.585651 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.586385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:41.588100 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.600000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1411/2853] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:41.605019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.616847 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670a79-7ff1-48cb-8e85-51a9cfd2ab12 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:41.621685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:41.622316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.622595 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.622870 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] PATH_INFO: `/v3/projects/54e018ca7fe44e10a632bf8cbf0bd4e7/users/207b77a8d371412fb3108e9ec558fd8b/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.641084 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e018ca7fe44e10a632bf8cbf0bd4e7, user_id=207b77a8d371412fb3108e9ec558fd8b, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:41.643861 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.709768 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1443/2854] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:41 2022] PUT /identity/v3/projects/54e018ca7fe44e10a632bf8cbf0bd4e7/users/207b77a8d371412fb3108e9ec558fd8b/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:41.713980 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.724814 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1fea5-df1b-4413-abdf-49a6f9949f2b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:41.788619 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a7b06-7799-4a20-8ca2-77190c3e125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:41.789237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a7b06-7799-4a20-8ca2-77190c3e125c admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.789521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a7b06-7799-4a20-8ca2-77190c3e125c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.789798 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a7b06-7799-4a20-8ca2-77190c3e125c admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.790476 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a7b06-7799-4a20-8ca2-77190c3e125c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:41.792091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a7b06-7799-4a20-8ca2-77190c3e125c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.803242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1412/2855] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:41.807533 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.818710 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3994-b655-49f7-b6b0-ecadc2f3427a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:41.823801 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:41.824577 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.824863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.825140 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] PATH_INFO: `/v3/projects/54e018ca7fe44e10a632bf8cbf0bd4e7/users/207b77a8d371412fb3108e9ec558fd8b/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.827118 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e018ca7fe44e10a632bf8cbf0bd4e7, user_id=207b77a8d371412fb3108e9ec558fd8b, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:41.830104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:41.841267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1444/2856] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:41 2022] PUT /identity/v3/projects/54e018ca7fe44e10a632bf8cbf0bd4e7/users/207b77a8d371412fb3108e9ec558fd8b/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:41.853559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:41.853905 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:41.854216 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:41.901532 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] MFA Rules not processed for user `207b77a8d371412fb3108e9ec558fd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:41.902745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:41.973553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1413/2857] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:41.984275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:41.986040 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:42.047961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:42.056619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc5a0c-1414-431e-bcb8-878d87f7d261 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:42.060439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570f957-53e0-4d3d-bcb0-e160324c86d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:42.076128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570f957-53e0-4d3d-bcb0-e160324c86d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:42.076128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570f957-53e0-4d3d-bcb0-e160324c86d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:42.076128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570f957-53e0-4d3d-bcb0-e160324c86d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:42.076128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570f957-53e0-4d3d-bcb0-e160324c86d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:42.076128 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570f957-53e0-4d3d-bcb0-e160324c86d7 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:42.083467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1445/2858] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:45.242107 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:45.252442 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:45.310396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24549a18-843f-462f-9941-8a3a5ccfa1b6 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:45.315158 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:45.315790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:45.316074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:45.316375 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] PATH_INFO: `/v3/users/78272c3bd729409b8a03ac990a6029c5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:45.317525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78272c3bd729409b8a03ac990a6029c5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:45.319919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:45.506249 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78272c3bd729409b8a03ac990a6029c5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:45.506899 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78272c3bd729409b8a03ac990a6029c5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:45.518960 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78272c3bd729409b8a03ac990a6029c5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:45.584154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78272c3bd729409b8a03ac990a6029c5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:45.584792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78272c3bd729409b8a03ac990a6029c5'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:45.598536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1414/2859] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:26:45 2022] DELETE /identity/v3/users/78272c3bd729409b8a03ac990a6029c5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:45.603266 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:45.603831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:45.603831 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:45.624641 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:45.625911 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:45.691685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1446/2860] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:45.701923 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:45.704260 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:45.768984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847939d5-fdd9-4f77-9b48-a83b4e095a5e admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:45.773301 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:45.773959 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:45.774339 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:45.774588 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:45.785559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:45.787122 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:45.798145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1415/2861] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:46.202199 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:46.203812 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:46.218698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d160-e057-4218-a47e-5b4a81b20eeb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:46.225334 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:46.226802 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:46.227086 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:46.227538 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] PATH_INFO: `/v3/projects/a07d6d5b6d864095bf9b08a745eeb2c2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:46.228865 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07d6d5b6d864095bf9b08a745eeb2c2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:46.230856 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:46.340569 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07d6d5b6d864095bf9b08a745eeb2c2', 'request_id': 'req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.346960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07d6d5b6d864095bf9b08a745eeb2c2', 'request_id': 'req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.446910 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07d6d5b6d864095bf9b08a745eeb2c2', 'request_id': 'req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.459418 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] The token cache is being invalidate because project a07d6d5b6d864095bf9b08a745eeb2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:26:46.459700 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.460369 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.462203 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1447/2862] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:26:46 2022] DELETE /identity/v3/projects/a07d6d5b6d864095bf9b08a745eeb2c2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:46.466731 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:46.479042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d1b1-68db-4cf2-9012-17f6f954b6bc service neutron] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:46.509003 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:46.536487 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:46.537074 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:46.537359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:46.537627 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] PATH_INFO: `/v3/users/207b77a8d371412fb3108e9ec558fd8b` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:46.538767 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=207b77a8d371412fb3108e9ec558fd8b)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:46.540683 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:46.707091 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207b77a8d371412fb3108e9ec558fd8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.708404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207b77a8d371412fb3108e9ec558fd8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.720667 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207b77a8d371412fb3108e9ec558fd8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.789720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207b77a8d371412fb3108e9ec558fd8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.790285 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-51aa739f-1d1d-43a8-b8c2-e847fa83e93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207b77a8d371412fb3108e9ec558fd8b'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:46.803316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1416/2863] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:26:46 2022] DELETE /identity/v3/users/207b77a8d371412fb3108e9ec558fd8b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:47.220456 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:47.222187 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:47.236321 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259d6b-4241-4c20-9da5-bdb3b6aa0c62 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:47.295640 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:47.296204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.296955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.296955 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] PATH_INFO: `/v3/projects/54e018ca7fe44e10a632bf8cbf0bd4e7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:47.297927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e018ca7fe44e10a632bf8cbf0bd4e7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:47.299863 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:47.312879 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:47.402829 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e018ca7fe44e10a632bf8cbf0bd4e7', 'request_id': 'req-a31f48da-eaf1-4a21-8260-90c76fdc8594'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:47.409267 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e018ca7fe44e10a632bf8cbf0bd4e7', 'request_id': 'req-a31f48da-eaf1-4a21-8260-90c76fdc8594'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:47.498046 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e018ca7fe44e10a632bf8cbf0bd4e7', 'request_id': 'req-a31f48da-eaf1-4a21-8260-90c76fdc8594'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:47.509110 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] The token cache is being invalidate because project 54e018ca7fe44e10a632bf8cbf0bd4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:26:47.509401 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:47.510078 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a31f48da-eaf1-4a21-8260-90c76fdc8594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:26:47.511592 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1448/2864] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:26:47 2022] DELETE /identity/v3/projects/54e018ca7fe44e10a632bf8cbf0bd4e7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:47.516558 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.517041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.517160 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:47.537439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:47.538678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:47.604682 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1417/2865] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:47.609275 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.609675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.610105 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:47.630666 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:47.631874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:47.639889 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1449/2866] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:47.644371 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:47.656046 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5cabd-981a-457c-8bff-145ea17f9b61 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:47.661320 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:47.661951 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.662229 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.662521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:47.663187 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:26:47.663465 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:47.665061 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:47.676864 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1418/2867] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:26:47.681269 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:47.690862 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75edd0-866e-4bf2-8607-fccd1b2e2ac4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:47.695605 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:47.696196 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.696474 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.696772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:47.697406 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:47.699335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:47.785306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1450/2868] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:26:47 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:47.790145 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:47.800219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e77a1-a1dc-4498-ae68-da603361d4f9 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:47.834316 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:47.857369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:47.857926 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.858213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.858489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:47.859126 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:47.861044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:47.979554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1419/2869] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:26:47 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:47.983466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:47.994248 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afd028-a81a-4262-8be4-7160347579d6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:47.998810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:47.999429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:47.999707 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:47.999977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.000614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.002245 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.013115 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1451/2870] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:48.017424 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.028171 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09183d-6292-419f-a7ff-f2cb5fa9ac63 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.033211 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4ef3b-7f93-44e8-9074-535703bdef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.033819 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ef3b-7f93-44e8-9074-535703bdef88 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.034123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ef3b-7f93-44e8-9074-535703bdef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.034399 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4ef3b-7f93-44e8-9074-535703bdef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.035043 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ef3b-7f93-44e8-9074-535703bdef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.036642 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4ef3b-7f93-44e8-9074-535703bdef88 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.047653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1420/2871] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:48.052126 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.062306 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e793d-76b2-421c-a0f2-4acb5f343463 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.067478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.068145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.068426 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.068704 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] PATH_INFO: `/v3/projects/c3373485356544caaaaa4d553a87840d/users/cf25516c58a049b9be06aa2bd6aecbf5/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.084657 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3373485356544caaaaa4d553a87840d, user_id=cf25516c58a049b9be06aa2bd6aecbf5, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.087384 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.161342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1452/2872] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:48 2022] PUT /identity/v3/projects/c3373485356544caaaaa4d553a87840d/users/cf25516c58a049b9be06aa2bd6aecbf5/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:26:48.171602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.171891 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.172168 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.200540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] MFA Rules not processed for user `cf25516c58a049b9be06aa2bd6aecbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:48.201930 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:48.266733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1421/2873] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:48.271811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.336074 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f744d0-64b1-4708-a822-d56fe688d955 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.340772 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.341376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.341652 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.341956 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.342584 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.344576 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.471776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1453/2874] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:26:48 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:48.476141 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.488004 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f07067-ba31-4a9f-aa29-f4ce99a33058 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.547188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.547893 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.548085 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.548359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.548998 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.551560 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.682093 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1422/2875] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:26:48 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:48.685965 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.696962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a8b6-01f4-4961-bea7-a077a19828ba admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.701551 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.702181 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.702459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.702730 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.703366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.705263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.716168 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1454/2876] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:48.720484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.731015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291d35-f651-40ae-93db-ead07a576532 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.735508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2cf9d-1bfd-47a1-ae97-dd7e14c57fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.736101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2cf9d-1bfd-47a1-ae97-dd7e14c57fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.736404 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2cf9d-1bfd-47a1-ae97-dd7e14c57fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.736678 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2cf9d-1bfd-47a1-ae97-dd7e14c57fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.737312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2cf9d-1bfd-47a1-ae97-dd7e14c57fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.739559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2cf9d-1bfd-47a1-ae97-dd7e14c57fcb admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.749439 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1423/2877] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:48.753415 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:48.763233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd48e4a-f715-49f5-9855-f09fb5097213 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:48.767709 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:48.768338 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.768614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.768883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] PATH_INFO: `/v3/projects/c134a53e132d4b919d1d6f85af149cd5/users/470d2804a4b34b0aa02758174286ba19/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.776830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:48.783458 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c134a53e132d4b919d1d6f85af149cd5, user_id=470d2804a4b34b0aa02758174286ba19, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:48.786669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:48.857621 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1455/2878] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:48 2022] PUT /identity/v3/projects/c134a53e132d4b919d1d6f85af149cd5/users/470d2804a4b34b0aa02758174286ba19/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:48.922907 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc607756-6366-43fe-be44-f5c38424211f None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:48.923191 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc607756-6366-43fe-be44-f5c38424211f None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:48.923497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc607756-6366-43fe-be44-f5c38424211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:48.951222 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-bc607756-6366-43fe-be44-f5c38424211f None None] MFA Rules not processed for user `470d2804a4b34b0aa02758174286ba19`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:48.952454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-bc607756-6366-43fe-be44-f5c38424211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:48.964221 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:49.016396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1424/2879] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:49.020929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.088723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da964db-8df3-4c49-ac97-4a013a831874 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.093803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.094445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.094723 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.094996 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.095630 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.097615 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.209521 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1456/2880] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:49.213749 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc607756-6366-43fe-be44-f5c38424211f None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.231519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc607756-6366-43fe-be44-f5c38424211f None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.282385 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.283000 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.283279 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.283553 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.284179 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.286942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.409005 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1425/2881] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:26:49 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:26:49.411787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.422386 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a534c-7528-487d-ab05-ff35f6363f31 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.426922 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.427515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.427798 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.428127 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.428794 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.430434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.442258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1457/2882] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:49.446521 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.457890 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a9b6-87e0-4a15-83c4-ce5cf1dbcdc5 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.462947 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.463778 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.464026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.464306 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] PATH_INFO: `/v3/projects/0c221743cbf34999b449ce68ad1b77a8/users/77fe5f55bc96443bbea34e9b74835a5b/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.480834 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c221743cbf34999b449ce68ad1b77a8, user_id=77fe5f55bc96443bbea34e9b74835a5b, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.483628 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.573234 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1426/2883] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:49 2022] PUT /identity/v3/projects/0c221743cbf34999b449ce68ad1b77a8/users/77fe5f55bc96443bbea34e9b74835a5b/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:49.577252 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.588582 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604b98-1ca0-49fe-b94f-2debeaa067dd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.644042 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e70cf5-dbf8-4b13-b44e-18d21cc35d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.645289 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70cf5-dbf8-4b13-b44e-18d21cc35d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.645580 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70cf5-dbf8-4b13-b44e-18d21cc35d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.645874 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70cf5-dbf8-4b13-b44e-18d21cc35d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.646515 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e70cf5-dbf8-4b13-b44e-18d21cc35d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.648112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e70cf5-dbf8-4b13-b44e-18d21cc35d79 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.658122 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1458/2884] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:26:49.662365 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.674990 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cef45-140d-4fe3-beb2-e8a66a093c4a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.679942 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.680611 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.680896 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.681177 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] PATH_INFO: `/v3/projects/0c221743cbf34999b449ce68ad1b77a8/users/77fe5f55bc96443bbea34e9b74835a5b/roles/c6edd32372bf4e9a9753c56a2c760041` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.683123 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c221743cbf34999b449ce68ad1b77a8, user_id=77fe5f55bc96443bbea34e9b74835a5b, role_id=c6edd32372bf4e9a9753c56a2c760041)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.685795 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.697157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1427/2885] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:26:49 2022] PUT /identity/v3/projects/0c221743cbf34999b449ce68ad1b77a8/users/77fe5f55bc96443bbea34e9b74835a5b/roles/c6edd32372bf4e9a9753c56a2c760041 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:26:49.707977 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.708244 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.708522 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.736013 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] MFA Rules not processed for user `77fe5f55bc96443bbea34e9b74835a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:26:49.737277 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:49.785219 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:49.808753 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1459/2886] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:26:49.820312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:49.822077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:49.883392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647cc70-f49b-4d35-8839-bf2d8a0d26bc admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:49.887037 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:49.887637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:49.887916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:49.888189 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:49.897403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:49.898838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:49.908120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1428/2887] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:50.999028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:51.000455 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:26:51.012985 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73326588-407b-47ac-8526-730ce07b90b0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:51.016445 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:51.017033 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:51.017312 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:51.017583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:51.074132 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:51.075579 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:51.085174 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1460/2888] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:26:56.062409 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:26:56.070996 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f6691-847e-453b-8a28-cf4e1a988cee service cinder] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:26:56.074847 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde53833-7ff7-4f88-b801-323241afbc92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:26:56.075427 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53833-7ff7-4f88-b801-323241afbc92 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:26:56.075706 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53833-7ff7-4f88-b801-323241afbc92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:26:56.075976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53833-7ff7-4f88-b801-323241afbc92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:26:56.081250 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:26:56.134919 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde53833-7ff7-4f88-b801-323241afbc92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:26:56.136352 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde53833-7ff7-4f88-b801-323241afbc92 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:26:56.145981 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1429/2889] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:26:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:00.114603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:00.177764 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f18903-3988-4e6a-8787-900c6d8a5775 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:00.182303 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:00.182927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:00.183208 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:00.183482 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] PATH_INFO: `/v3/users/cf25516c58a049b9be06aa2bd6aecbf5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:00.184603 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf25516c58a049b9be06aa2bd6aecbf5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:00.186586 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:00.363675 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf25516c58a049b9be06aa2bd6aecbf5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:00.364330 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf25516c58a049b9be06aa2bd6aecbf5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:00.371356 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf25516c58a049b9be06aa2bd6aecbf5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:00.384195 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf25516c58a049b9be06aa2bd6aecbf5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:00.510148 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf25516c58a049b9be06aa2bd6aecbf5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:00.512846 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:00.517285 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1461/2890] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:00 2022] DELETE /identity/v3/users/cf25516c58a049b9be06aa2bd6aecbf5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:00.521936 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:00.530293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:00.530293 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:00.542288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:00.543484 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:00.602739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1430/2891] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:00.612787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:00.614228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:00.693561 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e669e8-d3ba-4b89-b55f-fcc392caca0e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:00.697746 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:00.703425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:00.703425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:00.703425 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:00.708218 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:00.709763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:00.719291 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1462/2892] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:01.180213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:01.181771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:01.194081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c61b3-10d0-442d-a898-afc7cac007ce None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:01.199771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:01.199771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:01.199771 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:01.200104 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] PATH_INFO: `/v3/projects/c3373485356544caaaaa4d553a87840d` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:01.201185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3373485356544caaaaa4d553a87840d)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:01.203209 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:01.326157 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3373485356544caaaaa4d553a87840d', 'request_id': 'req-7489bdc1-8406-4dd7-8889-7d8389223a07'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.332921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3373485356544caaaaa4d553a87840d', 'request_id': 'req-7489bdc1-8406-4dd7-8889-7d8389223a07'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.395118 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3373485356544caaaaa4d553a87840d', 'request_id': 'req-7489bdc1-8406-4dd7-8889-7d8389223a07'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.405865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] The token cache is being invalidate because project c3373485356544caaaaa4d553a87840d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:01.406164 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.406792 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.408271 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1431/2893] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:01 2022] DELETE /identity/v3/projects/c3373485356544caaaaa4d553a87840d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:01.412363 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:01.422830 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9196a0c-444f-428f-89f9-7603fcf76290 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:01.481792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:01.482452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:01.482737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:01.483017 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] PATH_INFO: `/v3/users/470d2804a4b34b0aa02758174286ba19` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:01.484159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470d2804a4b34b0aa02758174286ba19)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:01.486120 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:01.641871 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470d2804a4b34b0aa02758174286ba19'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.642546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470d2804a4b34b0aa02758174286ba19'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.650189 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470d2804a4b34b0aa02758174286ba19'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.661808 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470d2804a4b34b0aa02758174286ba19'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.727049 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470d2804a4b34b0aa02758174286ba19'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:01.733553 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1463/2894] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:01 2022] DELETE /identity/v3/users/470d2804a4b34b0aa02758174286ba19 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:02.139467 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:02.141020 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:02.155185 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489bdc1-8406-4dd7-8889-7d8389223a07 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:02.186838 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:02.227672 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:02.228242 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:02.228743 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:02.229026 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] PATH_INFO: `/v3/projects/c134a53e132d4b919d1d6f85af149cd5` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:02.230637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c134a53e132d4b919d1d6f85af149cd5)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:02.232637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:02.323545 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c134a53e132d4b919d1d6f85af149cd5', 'request_id': 'req-eba32855-d415-4645-93e6-6dcf2dc4c0a1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.330205 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c134a53e132d4b919d1d6f85af149cd5', 'request_id': 'req-eba32855-d415-4645-93e6-6dcf2dc4c0a1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.389478 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c134a53e132d4b919d1d6f85af149cd5', 'request_id': 'req-eba32855-d415-4645-93e6-6dcf2dc4c0a1'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.400849 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] The token cache is being invalidate because project c134a53e132d4b919d1d6f85af149cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:02.401192 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.401871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.403434 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1432/2895] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:02 2022] DELETE /identity/v3/projects/c134a53e132d4b919d1d6f85af149cd5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:02.407467 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:02.408963 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:02.417023 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:02.422585 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ace65-82bf-471c-a2b3-8a912dd22530 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:02.489731 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:02.490342 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:02.490645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:02.491442 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] PATH_INFO: `/v3/users/77fe5f55bc96443bbea34e9b74835a5b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:02.492574 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fe5f55bc96443bbea34e9b74835a5b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:02.494534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:02.721761 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fe5f55bc96443bbea34e9b74835a5b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.722485 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fe5f55bc96443bbea34e9b74835a5b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.730940 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fe5f55bc96443bbea34e9b74835a5b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.743765 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fe5f55bc96443bbea34e9b74835a5b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.863840 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8f10f000-5ee5-456a-9cab-5abf12f21045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fe5f55bc96443bbea34e9b74835a5b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:02.870638 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1464/2896] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:02 2022] DELETE /identity/v3/users/77fe5f55bc96443bbea34e9b74835a5b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:03.298516 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:03.300542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:03.313969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba32855-d415-4645-93e6-6dcf2dc4c0a1 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:03.373357 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:03.374041 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:03.374334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:03.374610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] PATH_INFO: `/v3/projects/0c221743cbf34999b449ce68ad1b77a8` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:03.375813 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c221743cbf34999b449ce68ad1b77a8)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:03.377755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:03.516525 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c221743cbf34999b449ce68ad1b77a8', 'request_id': 'req-45c28004-0b8d-4e22-94a9-698bf9bf6574'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:03.522888 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c221743cbf34999b449ce68ad1b77a8', 'request_id': 'req-45c28004-0b8d-4e22-94a9-698bf9bf6574'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:03.601239 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c221743cbf34999b449ce68ad1b77a8', 'request_id': 'req-45c28004-0b8d-4e22-94a9-698bf9bf6574'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:03.603511 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:03.612366 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] The token cache is being invalidate because project 0c221743cbf34999b449ce68ad1b77a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:03.612806 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:03.613355 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-45c28004-0b8d-4e22-94a9-698bf9bf6574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:03.614871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1433/2897] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:03 2022] DELETE /identity/v3/projects/0c221743cbf34999b449ce68ad1b77a8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:03.621444 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f846-c908-4e63-a240-a75e28644195 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:03.621967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f846-c908-4e63-a240-a75e28644195 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:03.622085 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f846-c908-4e63-a240-a75e28644195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:03.641727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7069f846-c908-4e63-a240-a75e28644195 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:03.642958 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7069f846-c908-4e63-a240-a75e28644195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:03.703319 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1465/2898] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:27:03.713761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:03.714088 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:03.714353 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:03.734527 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:03.735760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:03.743720 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1434/2899] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:03.747981 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069f846-c908-4e63-a240-a75e28644195 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:03.757564 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069f846-c908-4e63-a240-a75e28644195 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:03.762095 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:03.762686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:03.762967 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:03.763239 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:03.763876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:27:03.764204 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:03.765787 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:03.777881 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1466/2900] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:27:03.782220 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:03.792082 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775886b-f8c0-4c9f-8529-a5b2092cfd9c None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:03.796945 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:03.797916 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:03.798386 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:03.798843 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:03.799901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:03.801999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:03.893664 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1435/2901] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:27:03 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:03.898534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:03.908452 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9ac04-855d-40ec-9aa4-056fb8197229 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:03.913876 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:03.965901 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:03.966499 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:03.966813 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:03.967103 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:03.967724 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:03.969651 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:04.029662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1467/2902] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:27:03 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:04.033775 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:04.044921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcf35f-b261-4e00-8810-837b08769386 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:04.049675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:04.050372 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.050656 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.050932 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.051574 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:04.053175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:04.063312 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1436/2903] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:04.067293 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:04.077820 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cb743-0802-4e6e-90f9-72817ce1579e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:04.082790 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834bcd-4693-445f-83be-bf933d0f3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:04.083378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834bcd-4693-445f-83be-bf933d0f3e08 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.083660 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834bcd-4693-445f-83be-bf933d0f3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.083933 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834bcd-4693-445f-83be-bf933d0f3e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.085191 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834bcd-4693-445f-83be-bf933d0f3e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:04.086883 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5834bcd-4693-445f-83be-bf933d0f3e08 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:04.097570 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1468/2904] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:04.101714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:04.111583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915c61f-d93d-4278-b5f3-dd66b89e088a admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:04.116435 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:04.117066 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.117347 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.117620 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] PATH_INFO: `/v3/projects/486a76e26e1f4a0c835df6d3c3eb139c/users/eabc784f574642fab0709ad12861cde0/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.132304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486a76e26e1f4a0c835df6d3c3eb139c, user_id=eabc784f574642fab0709ad12861cde0, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:04.134999 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:04.212270 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1437/2905] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:27:04 2022] PUT /identity/v3/projects/486a76e26e1f4a0c835df6d3c3eb139c/users/eabc784f574642fab0709ad12861cde0/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:04.223737 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.228849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.228849 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.251929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] MFA Rules not processed for user `eabc784f574642fab0709ad12861cde0`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:04.253116 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:04.316619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1469/2906] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:04.328958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:04.330992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:04.388303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29b7b-accd-42ca-ab77-734fd9eab576 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:04.392035 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b847c04-5bd5-45cf-9efe-e77c585ee831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:04.392645 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847c04-5bd5-45cf-9efe-e77c585ee831 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.392927 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847c04-5bd5-45cf-9efe-e77c585ee831 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.393206 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b847c04-5bd5-45cf-9efe-e77c585ee831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.402174 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847c04-5bd5-45cf-9efe-e77c585ee831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:04.403616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b847c04-5bd5-45cf-9efe-e77c585ee831 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:04.412377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1438/2907] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:04.431396 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:04.498534 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acefc0-1a75-40e5-94b8-155c41a85886 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:04.504941 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:04.505705 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.506012 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.506961 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] PATH_INFO: `/v3/users/eabc784f574642fab0709ad12861cde0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.508044 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabc784f574642fab0709ad12861cde0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:04.510020 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:04.541974 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:04.729038 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabc784f574642fab0709ad12861cde0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:04.729805 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabc784f574642fab0709ad12861cde0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:04.736791 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabc784f574642fab0709ad12861cde0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:04.749610 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabc784f574642fab0709ad12861cde0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:04.840929 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabc784f574642fab0709ad12861cde0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:04.847308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1470/2908] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:04 2022] DELETE /identity/v3/users/eabc784f574642fab0709ad12861cde0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:04.852723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:04.852723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:04.853022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:04.873790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:04.875042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:04.934246 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1439/2909] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:04.944159 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:04.945614 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:05.006504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f81a17-f99a-4df0-aeba-949b12e2a54c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:05.010080 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6dbed-5878-4b7a-9140-de2431869be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:05.010685 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6dbed-5878-4b7a-9140-de2431869be1 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:05.010986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6dbed-5878-4b7a-9140-de2431869be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:05.011263 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6dbed-5878-4b7a-9140-de2431869be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:05.020839 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6dbed-5878-4b7a-9140-de2431869be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:05.022417 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6dbed-5878-4b7a-9140-de2431869be1 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:05.031969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1471/2910] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:05.523308 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:05.528632 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:05.541334 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152539ed-67cf-49c7-b4d5-26973f21d7cc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:05.546373 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:05.547018 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:05.547300 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:05.547576 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] PATH_INFO: `/v3/projects/486a76e26e1f4a0c835df6d3c3eb139c` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:05.548714 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486a76e26e1f4a0c835df6d3c3eb139c)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:05.550729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:05.646750 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:05.663602 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486a76e26e1f4a0c835df6d3c3eb139c', 'request_id': 'req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:05.669739 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486a76e26e1f4a0c835df6d3c3eb139c', 'request_id': 'req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:05.742393 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486a76e26e1f4a0c835df6d3c3eb139c', 'request_id': 'req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:05.753461 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] The token cache is being invalidate because project 486a76e26e1f4a0c835df6d3c3eb139c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:05.753745 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:05.754395 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-c9b6ea7e-5d0a-4b93-af52-6677f9bb2431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:05.755871 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1440/2911] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:05 2022] DELETE /identity/v3/projects/486a76e26e1f4a0c835df6d3c3eb139c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:05.761416 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:05.761952 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:05.762058 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:05.786546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:05.786546 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:05.842509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1472/2912] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:05.850084 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:05.850396 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:05.850673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:05.870431 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:05.871637 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:05.879392 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1441/2913] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:05.884087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:05.893718 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76240c82-f2a1-4889-8dc8-4575d95a1b6e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:05.898838 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:05.899422 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:05.899701 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:05.899969 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:05.900596 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:27:05.900894 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:05.902497 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:05.913907 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1473/2914] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:27:05.918289 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:05.927369 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4d514-d8ee-4486-8a96-9f27195cdd59 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:05.932472 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:05.933128 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:05.933406 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:05.933675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:05.934459 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:05.936304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.030733 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1442/2915] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:27:05 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:06.034896 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:06.045439 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0761b-0255-4b87-8e72-881ed8a0f547 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:06.070419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:06.102332 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:06.102936 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.103216 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.103492 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.104124 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:06.106069 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.212233 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1474/2916] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:27:06 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:06.216559 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:06.227175 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc1fb-3a78-4ea6-83f8-056666e41182 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:06.231752 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:06.232793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.232793 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.233009 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.233497 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:06.235167 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.245604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1443/2917] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:06.249556 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:06.260450 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64241ec-1f6f-4f4b-8d1d-2f54d560637d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:06.265072 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e317a-b6cc-4b96-9932-58583954f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:06.265792 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e317a-b6cc-4b96-9932-58583954f236 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.266107 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e317a-b6cc-4b96-9932-58583954f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.266383 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e317a-b6cc-4b96-9932-58583954f236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.267025 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e317a-b6cc-4b96-9932-58583954f236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:06.268616 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e317a-b6cc-4b96-9932-58583954f236 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.278887 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1475/2918] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:27:06.282969 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:06.293508 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833145d-3a2d-4126-9409-4263fff8a6b7 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:06.298169 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:06.298757 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.299042 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.299322 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] PATH_INFO: `/v3/projects/754a25ed53d74c49a0f9c3760f2858ee/users/018157e0a1c94e3aa82965198f60aa3e/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.313976 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754a25ed53d74c49a0f9c3760f2858ee, user_id=018157e0a1c94e3aa82965198f60aa3e, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:06.316652 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.400822 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1444/2919] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:27:06 2022] PUT /identity/v3/projects/754a25ed53d74c49a0f9c3760f2858ee/users/018157e0a1c94e3aa82965198f60aa3e/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:06.413169 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.413459 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.413759 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.442816 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] MFA Rules not processed for user `018157e0a1c94e3aa82965198f60aa3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:06.444558 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:06.511349 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1476/2920] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:06.546554 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:06.549147 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:06.612330 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc7f28-87d6-4201-9708-56a211e2f6e6 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:06.615972 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10490d15-7d39-451d-8593-78da07d4197d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:06.616569 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490d15-7d39-451d-8593-78da07d4197d service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.616855 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490d15-7d39-451d-8593-78da07d4197d service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.617120 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10490d15-7d39-451d-8593-78da07d4197d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.625305 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10490d15-7d39-451d-8593-78da07d4197d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:06.626765 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10490d15-7d39-451d-8593-78da07d4197d service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.636364 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1445/2921] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:06.652478 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:06.714917 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeae60-1784-47de-b325-37b382f0bcdf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:06.719463 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:06.720087 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:06.720367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:06.720642 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] PATH_INFO: `/v3/users/018157e0a1c94e3aa82965198f60aa3e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:06.721822 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018157e0a1c94e3aa82965198f60aa3e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:06.723766 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:06.915583 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:06.923935 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018157e0a1c94e3aa82965198f60aa3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:06.926669 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018157e0a1c94e3aa82965198f60aa3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:06.932096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018157e0a1c94e3aa82965198f60aa3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:06.944734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018157e0a1c94e3aa82965198f60aa3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.000316 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018157e0a1c94e3aa82965198f60aa3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.007228 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1477/2922] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:06 2022] DELETE /identity/v3/users/018157e0a1c94e3aa82965198f60aa3e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:07.011824 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:07.012112 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:07.014402 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:07.031704 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:07.032918 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:07.081984 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:07.094760 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1446/2923] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:07.104960 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:07.106509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:07.163145 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a414-95c9-4f26-a2e1-f61720d0abd9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:07.168133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ac9c-c6fc-4138-a033-f39eb2b180ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:07.168133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ac9c-c6fc-4138-a033-f39eb2b180ed service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:07.168133 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ac9c-c6fc-4138-a033-f39eb2b180ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:07.168476 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ac9c-c6fc-4138-a033-f39eb2b180ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:07.177464 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ac9c-c6fc-4138-a033-f39eb2b180ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:07.179457 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026ac9c-c6fc-4138-a033-f39eb2b180ed service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:07.189278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1478/2924] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:07.687705 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:07.689259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:07.704022 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6778-c2f8-4df2-9faf-ba641990a43e None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:07.707089 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:07.707729 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:07.708034 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:07.708287 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] PATH_INFO: `/v3/projects/754a25ed53d74c49a0f9c3760f2858ee` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:07.710095 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754a25ed53d74c49a0f9c3760f2858ee)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:07.712023 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:07.794921 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754a25ed53d74c49a0f9c3760f2858ee', 'request_id': 'req-85cc3536-8b7e-4a56-9706-3e881d197ea0'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.801071 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754a25ed53d74c49a0f9c3760f2858ee', 'request_id': 'req-85cc3536-8b7e-4a56-9706-3e881d197ea0'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.857326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754a25ed53d74c49a0f9c3760f2858ee', 'request_id': 'req-85cc3536-8b7e-4a56-9706-3e881d197ea0'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.868233 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] The token cache is being invalidate because project 754a25ed53d74c49a0f9c3760f2858ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:07.868520 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.869140 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-85cc3536-8b7e-4a56-9706-3e881d197ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:07.870658 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1447/2925] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:07 2022] DELETE /identity/v3/projects/754a25ed53d74c49a0f9c3760f2858ee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:07.875698 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:07.875986 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:07.876258 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:07.897806 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:07.899037 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:07.955745 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1479/2926] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:07.964255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:07.964542 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:07.964883 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:07.984101 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:07.985296 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:07.993391 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1448/2927] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:07.997711 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.007774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ebe89-0de7-4be3-93ab-5ac976bd0a80 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.012229 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.012817 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.013096 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.013366 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.014028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:27:08.014328 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.015899 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.028036 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1480/2928] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:27:08.032255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.042132 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cae48a-0fc0-4239-80bf-b9b633fb7a8b None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.046761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.047359 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.047639 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.047917 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.048543 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.050489 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.139865 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1449/2929] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:27:08 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:08.144158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.154376 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade0ab7-e1f5-4a11-aa22-f0fa8d05c488 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.197891 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:08.214758 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.215436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.215619 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.215927 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.216618 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.218624 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.327142 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1481/2930] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:27:08 2022] POST /identity/v3/users => generated 282 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:27:08.331675 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.342610 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b347c5-c665-49bd-9b8e-bf616a491d67 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.347231 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.347929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.348182 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.348454 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.349193 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.351348 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.361477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1450/2931] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:08.365436 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.376057 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc6be2-0c12-4e44-a1b3-f05bdd58369f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.380686 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94790f-cf7c-4abf-ae3c-6c46bb086e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.381302 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94790f-cf7c-4abf-ae3c-6c46bb086e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.381774 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94790f-cf7c-4abf-ae3c-6c46bb086e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.382367 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94790f-cf7c-4abf-ae3c-6c46bb086e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.383549 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94790f-cf7c-4abf-ae3c-6c46bb086e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.385795 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94790f-cf7c-4abf-ae3c-6c46bb086e66 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.398001 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1482/2932] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:08.402653 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.413269 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06f07-a45b-4dc3-8847-5019ece35d48 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.418015 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.418663 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.418943 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.419218 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] PATH_INFO: `/v3/projects/594194021a9c477da46f9d7c77df2d1e/users/4dbc584f5824465981ae0f16fdf47b6d/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.434956 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] RBAC: Authorizing `identity:create_grant(project_id=594194021a9c477da46f9d7c77df2d1e, user_id=4dbc584f5824465981ae0f16fdf47b6d, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.437668 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.498203 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1451/2933] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:27:08 2022] PUT /identity/v3/projects/594194021a9c477da46f9d7c77df2d1e/users/4dbc584f5824465981ae0f16fdf47b6d/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:08.508491 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.508775 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.509052 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.539243 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] MFA Rules not processed for user `4dbc584f5824465981ae0f16fdf47b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:08.540475 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:08.604528 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1483/2934] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:08.615810 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:08.617519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:08.674420 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdcc3b-e821-4e81-b3f6-7af70925678b admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:08.678121 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156f10-01c0-4ac4-8741-612def484695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:08.678728 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156f10-01c0-4ac4-8741-612def484695 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:08.679007 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156f10-01c0-4ac4-8741-612def484695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:08.679280 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156f10-01c0-4ac4-8741-612def484695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:08.687591 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156f10-01c0-4ac4-8741-612def484695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:08.689025 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156f10-01c0-4ac4-8741-612def484695 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:08.698403 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1452/2935] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:18.601646 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:18.693755 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:44.902307 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:44.965663 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146ec5f-1d24-4cba-bc8c-a899503686b0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:44.970152 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:44.970776 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:44.971056 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:44.971331 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] PATH_INFO: `/v3/users/4dbc584f5824465981ae0f16fdf47b6d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:44.972465 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbc584f5824465981ae0f16fdf47b6d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:44.974421 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:45.131241 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbc584f5824465981ae0f16fdf47b6d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:45.131803 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbc584f5824465981ae0f16fdf47b6d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:45.138905 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbc584f5824465981ae0f16fdf47b6d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:45.151063 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbc584f5824465981ae0f16fdf47b6d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:45.262517 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbc584f5824465981ae0f16fdf47b6d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:45.269039 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1484/2936] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:44 2022] DELETE /identity/v3/users/4dbc584f5824465981ae0f16fdf47b6d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:45.273723 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81328771-6520-4d01-b622-fb86351914c9 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:45.274259 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81328771-6520-4d01-b622-fb86351914c9 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:45.274377 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81328771-6520-4d01-b622-fb86351914c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:45.294135 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-81328771-6520-4d01-b622-fb86351914c9 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:45.295326 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-81328771-6520-4d01-b622-fb86351914c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:45.354172 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1453/2937] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:45.364011 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:45.365988 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:45.422992 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba380e-cf16-4d38-aafb-8a409e776d29 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:45.426532 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26656236-659c-4b1b-ad98-c36296f22c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:45.427727 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656236-659c-4b1b-ad98-c36296f22c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:45.428005 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656236-659c-4b1b-ad98-c36296f22c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:45.428278 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26656236-659c-4b1b-ad98-c36296f22c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:45.437256 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26656236-659c-4b1b-ad98-c36296f22c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:45.438728 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26656236-659c-4b1b-ad98-c36296f22c08 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:45.448488 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1485/2938] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:45.812443 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81328771-6520-4d01-b622-fb86351914c9 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:45.814077 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-81328771-6520-4d01-b622-fb86351914c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:45.826786 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81328771-6520-4d01-b622-fb86351914c9 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:45.834370 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:45.835021 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:45.835276 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:45.835581 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] PATH_INFO: `/v3/projects/594194021a9c477da46f9d7c77df2d1e` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:45.836673 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=594194021a9c477da46f9d7c77df2d1e)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:45.839929 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:45.965949 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594194021a9c477da46f9d7c77df2d1e', 'request_id': 'req-9639895b-1e22-4410-928a-92435125ab4e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:45.971993 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594194021a9c477da46f9d7c77df2d1e', 'request_id': 'req-9639895b-1e22-4410-928a-92435125ab4e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:46.051081 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594194021a9c477da46f9d7c77df2d1e', 'request_id': 'req-9639895b-1e22-4410-928a-92435125ab4e'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:46.061901 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] The token cache is being invalidate because project 594194021a9c477da46f9d7c77df2d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:46.065953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:46.065953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-9639895b-1e22-4410-928a-92435125ab4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:46.065953 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1454/2939] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:45 2022] DELETE /identity/v3/projects/594194021a9c477da46f9d7c77df2d1e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:46.069810 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.070317 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.070428 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.090999 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:46.092194 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:46.108739 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:46.150866 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1486/2940] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:46.158928 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.162079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.162079 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.179044 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:46.180256 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:46.188156 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1455/2941] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:46.192962 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.202738 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca04c-e3b2-4b46-9de2-f9aae910fc91 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.208098 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.209185 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.209461 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.209734 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.210424 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:27:46.210726 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.212308 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.223842 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1487/2942] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Oct 10 12:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:27:46.228049 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.237616 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89030893-fb0c-4f60-a2b0-d9d11ffeacbc None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.242362 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.243479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.243479 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.243761 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.244143 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.246048 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.350087 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1456/2943] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Oct 10 12:27:46 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:46.354440 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.364566 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef842-1bd0-46ff-bbbe-1f6499abb465 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.422747 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.423318 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.423600 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.423873 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.424508 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.426466 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.520247 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1488/2944] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Oct 10 12:27:46 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:27:46.524356 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.534790 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601bf1-8bbc-49ca-b016-a626a4b2d6a2 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.539638 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.540237 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.540519 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.540791 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.541447 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.543288 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.553958 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1457/2945] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:46.558198 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.569099 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1efc2-6042-4acd-bdf4-afdbfac9f15a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.574164 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a633-6d9f-45a7-8c4d-eefe5156e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.574818 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a633-6d9f-45a7-8c4d-eefe5156e816 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.575102 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a633-6d9f-45a7-8c4d-eefe5156e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.575378 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a633-6d9f-45a7-8c4d-eefe5156e816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.576112 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1a633-6d9f-45a7-8c4d-eefe5156e816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.577763 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1a633-6d9f-45a7-8c4d-eefe5156e816 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.590071 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1489/2946] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Oct 10 12:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:27:46.594304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.604495 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000b45-1b2d-43fd-a99f-37e844f19f71 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.608988 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.609701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.610038 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.610255 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] PATH_INFO: `/v3/projects/a3ccfe8b346346fb89bfebc7c77a8ff2/users/ac14929098ec4e6c909a34c4b4e17b0c/roles/7acb4f2b69ec4c21a3c969d994c72845` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.625195 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ccfe8b346346fb89bfebc7c77a8ff2, user_id=ac14929098ec4e6c909a34c4b4e17b0c, role_id=7acb4f2b69ec4c21a3c969d994c72845)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.627992 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.702842 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1458/2947] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Oct 10 12:27:46 2022] PUT /identity/v3/projects/a3ccfe8b346346fb89bfebc7c77a8ff2/users/ac14929098ec4e6c909a34c4b4e17b0c/roles/7acb4f2b69ec4c21a3c969d994c72845 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:46.713412 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.713696 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.714028 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.742280 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] MFA Rules not processed for user `ac14929098ec4e6c909a34c4b4e17b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:46.743493 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:46.809823 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1490/2948] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:46.820621 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:46.822430 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:46.846801 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:46.893583 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cbbd1-1e7d-4a93-8ed6-51d9cab51939 admin admin] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:46.897303 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2227-be6b-4a76-8615-2448a518aab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e8ae06eace4634ac1a52ddab162d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:46.897931 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2227-be6b-4a76-8615-2448a518aab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:46.898213 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2227-be6b-4a76-8615-2448a518aab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:46.898485 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2227-be6b-4a76-8615-2448a518aab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:46.906861 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2227-be6b-4a76-8615-2448a518aab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:46.908284 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2227-be6b-4a76-8615-2448a518aab4 service cinder] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:46.917725 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1459/2949] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:56.807380 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:56.948413 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=22 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:27:58.519684 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:58.581912 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46739b12-c938-4691-99d0-3e68909a4755 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:58.586261 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:58.586882 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:58.587158 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:58.587429 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] PATH_INFO: `/v3/users/ac14929098ec4e6c909a34c4b4e17b0c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:58.589050 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac14929098ec4e6c909a34c4b4e17b0c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:58.591016 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:58.773000 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac14929098ec4e6c909a34c4b4e17b0c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:58.773645 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac14929098ec4e6c909a34c4b4e17b0c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:58.781504 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac14929098ec4e6c909a34c4b4e17b0c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:58.793811 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac14929098ec4e6c909a34c4b4e17b0c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:58.867783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac14929098ec4e6c909a34c4b4e17b0c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:58.874313 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1491/2950] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Oct 10 12:27:58 2022] DELETE /identity/v3/users/ac14929098ec4e6c909a34c4b4e17b0c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:27:58.878536 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] REQUEST_METHOD: `POST` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:58.879028 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:58.879154 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:58.899498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.auth.core [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] MFA Rules not processed for user `8fe6fac414db46e48e059a12469c4bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:27:58.901304 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:58.961498 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1460/2951] 10.222.0.47 () {58 vars in 958 bytes} [Mon Oct 10 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:27:58.972019 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:58.973509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:59.039335 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ecc8-77ad-47b0-aa4c-3d618505bfb3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:59.043104 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa49e174aaa14829a0281441a834ef4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:59.043706 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:59.043989 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:59.044260 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:59.053320 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:59.054783 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:59.064662 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1492/2952] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:27:59.504857 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] Authenticating user token {{(pid=81598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:27:59.506490 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.fernet_utils [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:27:59.519540 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8fdc2-b116-4def-a931-f3f289e106a1 None None] Validating token access rules against request {{(pid=81598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:27:59.524491 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe6fac414db46e48e059a12469c4bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cf9335e1dea43c7bd781d2850348eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:27:59.525188 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:27:59.525477 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:27:59.525751 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] PATH_INFO: `/v3/projects/a3ccfe8b346346fb89bfebc7c77a8ff2` {{(pid=81598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:27:59.526909 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ccfe8b346346fb89bfebc7c77a8ff2)` {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:27:59.528828 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] RBAC: Authorization granted {{(pid=81598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:27:59.624747 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ccfe8b346346fb89bfebc7c77a8ff2', 'request_id': 'req-8972aef2-3c81-4b18-bbd8-cec439fb02fa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:59.631380 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ccfe8b346346fb89bfebc7c77a8ff2', 'request_id': 'req-8972aef2-3c81-4b18-bbd8-cec439fb02fa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:59.696802 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ccfe8b346346fb89bfebc7c77a8ff2', 'request_id': 'req-8972aef2-3c81-4b18-bbd8-cec439fb02fa'} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:59.708692 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] The token cache is being invalidate because project a3ccfe8b346346fb89bfebc7c77a8ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:27:59.709381 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:59.709701 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG keystone.notifications [None req-8972aef2-3c81-4b18-bbd8-cec439fb02fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:27:59.711219 dv-cinder-860209-4-smb devstack@keystone.service[81598]: [pid: 81598|app: 0|req: 1461/2953] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Oct 10 12:27:59 2022] DELETE /identity/v3/projects/a3ccfe8b346346fb89bfebc7c77a8ff2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:28:09.060509 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:28:09.705604 dv-cinder-860209-4-smb devstack@keystone.service[81598]: DEBUG dbcounter [-] [81598] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:31:33.317002 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:31:33.318434 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:31:33.389210 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8bcbe-35f8-4629-b934-7829bfc58650 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:31:33.449557 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fa43b5c630e4d99af9a09bfad65d1cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '454839cce5ad47098ca56e007a5a0baa', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:31:33.450182 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:31:33.450470 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:31:33.450755 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:31:33.452519 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:31:33.465740 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:31:33.467375 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec52ce8-f160-4bb1-8415-436d483a79b5 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:31:33.478419 dv-cinder-860209-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1493/2954] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Oct 10 12:31:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:31:43.473441 dv-cinder-860209-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=58 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}